Tech stack
7 projects use CMake.
Run open language models locally with one command
Ollama reduced local model hosting from an afternoon of CUDA troubleshooting to a single pull command. It handles model download, quantisation selection, GPU offloading, and memory management, and exposes an OpenAI-compatible endpoint on localhost.
Inference engine that runs LLMs on almost any hardware
llama.cpp is the layer most local model tooling is built on. It is a C and C++ inference engine with no Python runtime, aggressive quantisation support, and hand-tuned kernels for a remarkably wide range of hardware.
Free open-source software for live streaming and screen recording
OBS Studio is free and open-source software for live streaming and video recording, mixing scenes and sources on Windows, Mac, and Linux.
Speech recognition that runs anywhere, with no runtime
whisper.cpp is a C and C++ port of the Whisper speech recognition model with no Python dependency, quantised weights, and hardware acceleration across Apple Silicon, CUDA, and plain CPU.
Free open-source multitrack audio editor and recorder
Audacity is a free, open-source multitrack audio editor and recorder for Windows, macOS, and Linux, used for podcasts, music, and field recording.