Tag
18 catalogue entries use this topic; each Project's license policy is labeled separately.
Run open language models locally with one command
Ollama reduced local model hosting from an afternoon of CUDA troubleshooting to a single pull command. It handles model download, quantisation selection, GPU offloading, and memory management, and exposes an OpenAI-compatible endpoint on localhost.
Inference engine that runs LLMs on almost any hardware
llama.cpp is the layer most local model tooling is built on. It is a C and C++ inference engine with no Python runtime, aggressive quantisation support, and hand-tuned kernels for a remarkably wide range of hardware.
Private desktop chatbot that runs open LLMs fully on-device
GPT4All is a free desktop app from Nomic that runs open language models entirely on your own computer, with no cloud calls.
Self-hosted AI workspace for chatting with documents and running agents
AnythingLLM is a self-hostable AI workspace for chatting with documents, running AI agents, and switching between local and hosted language models.
Self-hosted OpenAI-compatible runtime for local AI models
LocalAI is a self-hosted runtime that runs AI models locally behind OpenAI-compatible endpoints.
The open-source, self-hosted AI chat platform for every model.
LibreChat is a free, self-hosted chat workspace for many AI providers and local models, with agents, retrieval, and team controls.
Open-source desktop app for chatting with AI models fully offline
Jan is a free, open-source desktop app for chatting with AI models on your own computer, working fully offline once models are downloaded.
Speech recognition that runs anywhere, with no runtime
whisper.cpp is a C and C++ port of the Whisper speech recognition model with no Python dependency, quantised weights, and hardware acceleration across Apple Silicon, CUDA, and plain CPU.
Open-source AI second brain for notes, agents, and automations
Khoj is a self-hosted AI second brain that answers from personal notes and the web, with custom agents and scheduled automations.
Open-source local AI meeting notes for macOS and Windows
Meetily is an MIT-licensed, open-source meeting assistant for macOS and Windows that transcribes on-device and drafts minutes, summaries, and action items privately.
Free open-source macOS dictation with on-device AI cleanup
FluidVoice is a free macOS dictation app that transcribes speech on the machine and types polished text into any app, positioned as a local alternative to Wispr Flow.
Local voice dictation with AI cleanup for macOS
VoiceInk transcribes speech on the machine itself using a local Whisper model, then runs the raw transcript through a cleanup pass that removes filler and applies punctuation.
Private offline AI chat with on-device LLMs for iPhone and Mac
Fullmoon is a free app that chats with small open language models running entirely on your iPhone, iPad, or Mac, with no account and nothing sent to the cloud.
Free open-source meeting memory your AI can query
Minutes is a free, MIT-licensed meeting-memory app for Mac and Windows that transcribes meetings on-device into Markdown your AI assistant can query.
Open-source AI dictation that turns speech into formatted text in any app
Amical is an open source AI dictation app for macOS and Windows that transcribes speech and inserts formatted text into whichever app is focused.
Offline voice-to-text dictation with a one-time lifetime license
Voicetypr is an offline-first voice-to-text dictation app for macOS and Windows that transcribes speech on the device and types the result wherever the cursor is, sold as a one-time $49 lifetime license.
Free open-source AI note taker with bot-free meeting transcription
Prismical is a free, open-source AI note taker that transcribes meetings, lectures, and voice notes with local AI and no call bots.
Desktop application for running language models locally
LM Studio made local models approachable for people who do not want a terminal. Browse a catalogue, download a quantisation that fits the machine, and chat, with hardware requirements explained in plain language.