BaseRT
BaseRT is the fastest LLM runtime on Apple Silicon, designed for engineers building on-device AI. It runs open source models locally with one command, offering up to 6.4x faster prefill than llama.cpp and 3.9x faster than MLX, with up to 1.33x faster decode.
Fastest LLM runtime on Apple Silicon
- Running local LLMs for on-device AI development
- Powering coding agents with private, offline inference
- Accelerating model prefill and decode for Apple Silicon users
- Serving open source models for prototyping and testing
- Enabling privacy-preserving AI workflows without cloud dependencies
- Install BaseRT with a single command on your Apple Silicon device
- Serve a supported open source model using BaseRT
- Point your local coding agent or application to the served model endpoint
- Run inference entirely on-device without API keys or data leaving your machine
- Monitor performance metrics like tokens per second
Full-Stack Platform for Training Small Language Models
Give Claude Code and Codex a voice
The Web Data API for AI Agents and Developers
The terminal and Mac menu bar companion for Kickbacks.ai
Catch API drift before your customers do
AI platform for deep video understanding
Keep any Mac window visible in a floating mini screen
See it once. Ask forever.
Caps Lock keeps your Mac awake, even with the lid closed
A terminal, a real browser, and Claude Code under one roof
Control panel for AI agents on your lock screen
Manage your team of AI agents by voice, from anywhere
AI-powered schematic design tool for PCB making
A modern, visual file manager for the terminal
Control every aspect of model training and fine-tuning
Instant, hardware Isolated Sandboxes for AI agents
Find & fix live vulnerabilities in Vibe Apps with 1-prompt.
The open source Ahrefs alternative
