BaseRT
BaseRT is the fastest LLM runtime on Apple Silicon, designed for engineers building on-device AI. It runs open source models locally with one command, offering up to 6.4x faster prefill than llama.cpp and 3.9x faster than MLX, with up to 1.33x faster decode.
Fastest LLM runtime on Apple Silicon
- Running local LLMs for on-device AI development
- Powering coding agents with private, offline inference
- Accelerating model prefill and decode for Apple Silicon users
- Serving open source models for prototyping and testing
- Enabling privacy-preserving AI workflows without cloud dependencies
- Install BaseRT with a single command on your Apple Silicon device
- Serve a supported open source model using BaseRT
- Point your local coding agent or application to the served model endpoint
- Run inference entirely on-device without API keys or data leaving your machine
- Monitor performance metrics like tokens per second
Annotate anything for humans and their agents
Clone any website into clean code. Free & open source
See it once. Ask forever.
Control every aspect of model training and fine-tuning
A modern, visual file manager for the terminal
Privacy-friendly web analytics with traffic and revenue.
AI-powered schematic design tool for PCB making
Scale PostgreSQL without changing your app
Find & fix live vulnerabilities in Vibe Apps with 1-prompt.
The Web Data API for AI Agents and Developers
Catch API drift before your customers do
AI platform for deep video understanding
Approve AI agent data access with Face ID
Your time travel debugger
Screen recordings that edit themselves
Manage your team of AI agents by voice, from anywhere
Instant, hardware Isolated Sandboxes for AI agents
Caps Lock keeps your Mac awake, even with the lid closed
