Pybind11 bindings for Whisper.cpp

LLM training in simple, raw C/CUDA

llama.cpp gguf file parser for javascript

A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.

Standalone app for easy RAG with local LLM

LLocalSearch is a completely locally running search aggregator using LLM Agents. The user can ask a question and the system will use a chain of LLMs to find the answer. The user can see the progres…

High-level, optionally asynchronous Rust bindings to llama.cpp

WebAssembly binding for llama.cpp - Enabling in-browser LLM inference

Local CLI Copilot, powered by CodeLLaMa. 💻🦙

A set of AI-enabled effects, generators, and analyzers for Audacity®.

A super simple web interface to perform blind tests on LLM outputs.

Pure DOOM - Single Header Doom Source Port

An AI assistant beyond the chat box.

emoji_finder

lightweight, standalone C++ inference engine for Google's Gemma models.

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

Detect file content types with deep learning

Self-organizing AI note-taking app that runs models locally.

WebAssembly (Wasm) Build and Bindings for llama.cpp

Reverse engineering the rk3588 npu

Gnome shell extension for accurate speech to text input in Linux using whisper.cpp. Input text from speech anywhere.

🔥 TUI interface for LLMs written in Rust

GGML implementation of BERT model with Python bindings and quantization.

Implementation of C++ standard libraries in C

Run LLMs on weak devices or make powerful devices even more powerful by distributing the workload and dividing the RAM usage.

Pure C++ implementation of several models for real-time chatting on your computer (CPU)

Inference of Mamba models in pure C

The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). It provides a simple yet robust interface using llama-cpp-python, allowing users to chat wit…

Create characters in Unity with LLMs!