Skip to main content
OpenSourceAlternatives

llama.cpp

Open source · OSI-approvedStatus: unknown

Inference engine that runs LLMs on almost any hardware

Official site Repository

llama.cpp is the layer most local model tooling is built on. It is a C and C++ inference engine with no Python runtime, aggressive quantisation support, and hand-tuned kernels for a remarkably wide range of hardware.

It rewards people who want control. Context length, thread counts, GPU layer splits, and cache types are all exposed, and the bundled server speaks an OpenAI-compatible API for anything that needs one.

Decisive facts

  • Quantisation from 8-bit down to sub-2-bit formats
  • Apple Silicon, CUDA, ROCm, Vulkan, and pure CPU backends
  • Bundled OpenAI-compatible server binary
  • Grammar-constrained sampling for structured output
  • No Python runtime required at inference time
LLM Runtimes & ChatDeveloper Toolscppllminferencequantizationlocal-ai

Alternatives to llama.cpp

LM Studio

Desktop application for running language models locally

Similar source projects

Computed from shared categories, tags, and license. This is similarity, not an alternative claim, and paid weight is always zero.

Ollama

OllamaAIOpen

Run open language models locally with one command

Stars179.9K
Commit14h ago
LicenseMIT

Ollama reduced local model hosting from an afternoon of CUDA troubleshooting to a single pull command. It handles model download, quantisation selection, GPU offloading, and memory management, and exposes an OpenAI-compatible endpoint on localhost.

Alternative tolm studio

2 shared categories; 3 shared tags; same MIT license · organic similarity 1600

whisper.cpp

whisper.cppAIOpen

Speech recognition that runs anywhere, with no runtime

Stars43.2K
Commit1d ago
LicenseMIT

whisper.cpp is a C and C++ port of the Whisper speech recognition model with no Python dependency, quantised weights, and hardware acceleration across Apple Silicon, CUDA, and plain CPU.

Alternative towispr flow

2 shared categories; 3 shared tags; same MIT license · organic similarity 1600

VoiceInk

VoiceInkAIOpen

Local voice dictation with AI cleanup for macOS

Stars6,222
Commit23h ago
LicenseGPL-3.0

VoiceInk transcribes speech on the machine itself using a local Whisper model, then runs the raw transcript through a cleanup pass that removes filler and applies punctuation.

Alternative towispr flow

2 shared categories; 1 shared tag · organic similarity 1300

OpenCode

OpenCodeAIOpen

AI coding agent for terminal, editor, and desktop

Stars202.9K
Commit8h ago
LicenseMIT

OpenCode is a coding agent that runs where you already work rather than in a separate chat window. The same session can be driven from a terminal, an editor extension, or a desktop client, and it keeps context across all three.

Alternative togithub copilot

1 shared category; 1 shared tag; same MIT license · organic similarity 800

Godot Engine

Godot EngineOpen

Free 2D and 3D game engine with no royalties

Stars116.5K
Commit22h ago
LicenseMIT

Godot ships a complete engine, editor, and export pipeline under the MIT licence, which means no royalties, no revenue thresholds, and no licensing conversation before a project starts.

Alternative tounity

1 shared category; 1 shared tag; same MIT license · organic similarity 800

Firecrawl

FirecrawlAIOpen

Turn any website into clean, model-ready data

Stars174.9K
Commit11h ago
LicenseAGPL-3.0

Firecrawl handles the unglamorous part of feeding the web to a language model: rendering JavaScript, following pagination, stripping navigation and cookie banners, and returning markdown or structured JSON that a model can actually use.

Alternative tobrowserbase

1 shared category; 1 shared tag · organic similarity 700