Pure C wrapper library to use llama.cpp with Linux and Windows as simple as possible.
☆16Nov 13, 2026Updated this week
Alternatives and similar repositories for mt_llm
Users that are interested in mt_llm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Enhances Kokoro TTS output by merging segments with dynamic, programmable pauses for meditative or narrative flow.☆17Oct 16, 2025Updated last year
- Mic-controlled mouse clicks☆17Oct 6, 2025Updated last year
- Generate Duolingo-style quiz courses from PDFs with spaced repetition, adaptive difficulty, and tutor chat.☆22Apr 6, 2026Updated 7 months ago
- A local-first LLM development studio. Build, test, and customize inference workflows with your own models — no cloud, totally local.☆16May 21, 2025Updated last year
- win32 native frontend for llama-cli☆14Nov 2, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Zig-based Ollama alternative for running LLMs locally. Built on top of llama.cpp.zig bindings☆12Mar 6, 2026Updated 8 months ago
- An fully autonomous agent that accesses the browser and performs tasks.☆19Aug 17, 2026Updated 3 months ago
- Experimental interface environment for open source LLM, designed to democratize the use of AI. Powered by llama-cpp, llama-cpp-python and…☆19Oct 11, 2025Updated last year
- My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated☆36Aug 14, 2024Updated 2 years ago
- Native desktop app & game engine in HTML/CSS/JS with 3D, Jolt physics, audio, on-device AI, GPU shaders, and in-process SMT verification …☆15Updated this week
- ☆13Feb 17, 2025Updated last year
- Lightweight C inference for Qwen3 GGUF. Multiturn prefix caching & batch processing.☆28Sep 1, 2025Updated last year
- ☆11May 29, 2026Updated 5 months ago
- Offline LLM chatbot with personalized memory — works on CPU with multi-session memory support.☆22Jan 10, 2026Updated 10 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- your private, personal assistant☆83Updated this week
- Aidlab Code Examples for Python https://www.aidlab.com/developer☆13Nov 2, 2026Updated 2 weeks ago
- Schema-aware JSON compression with millisecond lookups — cut transfer/storage while enabling exists /pos queries. (Demo + wheels; core is…☆25Feb 21, 2026Updated 8 months ago
- GUI tool to QLoRA/LoRA-fine-tune LLMs and deploy to Ollama. Broad GPU support (NVIDIA/AMD/Intel/Apple) + CPU fallback.☆15Feb 18, 2026Updated 9 months ago
- This is a fork of SGLang for hip-attention integration. Please refer to hip-attention for detail.☆18Mar 31, 2026Updated 7 months ago
- Kotai is a fully local, zero-cost voice assistant that combines the power of Kyutai TTS/STT, LiveKit, and local LLMs to create natural co…☆10Jul 14, 2025Updated last year
- A user-friendly GUI for llama.cpp — convert, quantize, and run GGUF models without touching the terminal.☆25Updated this week
- Run Orpheus 3B Locally with Gradio UI, Standalone App☆25Apr 1, 2025Updated last year
- ComfyUI custom nodes for NVIDIA PersonaPlex - real-time speech-to-speech conversational AI☆11Mar 28, 2026Updated 7 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Dashboard v5 Coming Soon!!☆65Feb 15, 2026Updated 9 months ago
- Two environment variables that fix PyTorch/glibc memory creep on Linux. Zero code changes. Zero performance cost.☆15Jul 10, 2026Updated 4 months ago
- ☆51Feb 19, 2025Updated last year
- ☆21Oct 21, 2026Updated 3 weeks ago
- My in-development voice assistant!☆37Nov 20, 2025Updated 11 months ago
- ☆12Aug 17, 2024Updated 2 years ago
- CPU-optimized LLM inference engine (C)☆57Updated this week
- Real-time voice conversation system with Sesame CSM, featuring web-based audio visualization and GPU acceleration. Educational implementa…☆17Mar 18, 2025Updated last year
- Creating AI agents with the simplicity of Python in Java.☆14Mar 21, 2026Updated 7 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- A Docker container filled with pre-built versions of video streaming related tools☆11Mar 12, 2019Updated 7 years ago
- Useful Nautilus Scripts made with☆13Jul 27, 2021Updated 5 years ago
- A minimal, hackable implementation of Claude’s code☆12Dec 7, 2025Updated 11 months ago
- A minimal, clean D language interface for running LLM inference using importC around llama.cpp.☆25Oct 29, 2026Updated 2 weeks ago
- Tool for flashing linux on MSM8916 modems☆25Updated this week
- ☆12Jun 27, 2025Updated last year
- ☆27Jun 11, 2025Updated last year
Are these results useful?