Ultra-lightweight C++ inference engine for BitMamba-2 (1.58-bit SSM). Runs 1B models on consumer CPUs at 50+ tok/s using <700MB RAM. No heavy dependencies.
☆21Jun 2, 2026Updated last month
Alternatives and similar repositories for bitmamba.cpp
Users that are interested in bitmamba.cpp are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official implementation of BitMamba-2. A scalable 1.58-bit State Space Model (Mamba-2 + BitNet) trained from scratch on 150B tokens. Incl…☆26Feb 4, 2026Updated 5 months ago
- Minimal, zero-dependency LLM inference in pure C11. CPU-first with NEON/AVX2 SIMD. Flash MoE (pread + LRU expert cache). TurboQuant 3-bit…☆22Updated this week
- Lightweight C inference for Qwen3 GGUF. Multiturn prefix caching & batch processing.☆25Sep 1, 2025Updated 10 months ago
- Scripts for fbfrog-based FreeBASIC bindings☆16Mar 16, 2025Updated last year
- Experience the power of AI with this free AI voice generator demo. Utilizing Deepgram and Groq, we transform text into voice seamlessly. …☆38Jun 12, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Single-file, pure CUDA C implementation for running inference on Qwen3 0.6B GGUF. No Dependencies.☆24Nov 26, 2025Updated 7 months ago
- Load and run Llama from safetensors files in C☆15Oct 24, 2024Updated last year
- A repository to store helpful information and emerging insights in regard to LLMs☆21Oct 27, 2023Updated 2 years ago
- Production-ready ternary quantized (1.58-bit) Rust code generation model with mHC-lite, MaxRL training, and comprehensive benchmarking☆21Mar 7, 2026Updated 4 months ago
- ☆43Aug 2, 2025Updated 11 months ago
- A vaporwave-style sky material for Godot 4☆14Aug 2, 2024Updated last year
- ☆19Feb 23, 2026Updated 4 months ago
- this is a dungeon ai run locally that use your llm in the terminal with multiple players from 2 to 5☆17Jan 25, 2026Updated 5 months ago
- A char level language model☆18Jun 14, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆15Dec 7, 2025Updated 7 months ago
- Bloat Free, Portable and Lightweight LLM Frontend (Single HTML file). With Lorebook, Web Search, Macro Engine etc.☆22Updated this week
- A bot that checks your grammar and phrasing using LLM of choice☆35Feb 6, 2025Updated last year
- An experimental desktop client for using Claude Desktop's MCP with Novelcrafter codices.☆11Dec 3, 2024Updated last year
- Syntax Coloring for Freebasic in VScode☆13Mar 19, 2024Updated 2 years ago
- Good South is a spiritual successor/remix of Bad North, a minimalist Real-Time Strategy game.☆14Apr 23, 2021Updated 5 years ago
- Communicate undetected in plain sight using zero width obfuscation.☆15Nov 5, 2021Updated 4 years ago
- ☆16Oct 27, 2022Updated 3 years ago
- AutoREADME is an AI-powered tool that genereates a README file for any given input repository.☆34Oct 2, 2024Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Android APP Music Player with AndroidX Media3☆10Jun 10, 2026Updated last month
- A zero-allocation, header-only C++ BPE tokenizer for Qwen, built for maximum inference throughput.☆22Apr 3, 2026Updated 3 months ago
- file downloader (through http) supporting a progress bar☆17Aug 7, 2024Updated last year
- An API for VoiceCraft.☆25Jun 27, 2024Updated 2 years ago
- A package manager for Godot using NPM☆17Jan 11, 2023Updated 3 years ago
- Ring signatures (SAG, BLSAG) for Nostr, written in Rust 🦀☆18Apr 6, 2025Updated last year
- Implementation of mamba with rust☆96Mar 9, 2024Updated 2 years ago
- Full feature nostr client found at nostr.blue☆15Jul 11, 2026Updated last week
- This is a basic implementation of a third person controller in Godot 4.0 with basic state machine.☆17Mar 13, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Use Codestral Mamba with Visual Studio Code and the Continue extension. A local LLM alternative to GitHub Copilot.☆31Jul 18, 2024Updated 2 years ago
- Custom Node in the godot engine. Attachable to LineEdit to create auto complete menu☆16Jan 26, 2025Updated last year
- A lightweight GIF reader and writer for Godot Engine☆15Jul 3, 2026Updated 2 weeks ago
- NES emulator written in pure FreeBASIC with love by Blyss Sarania and Gavin Schulte(Nobbs66).☆21Oct 29, 2025Updated 8 months ago
- qwen2 and llama3 cpp implementation☆50Jun 7, 2024Updated 2 years ago
- Persistent caching for Python functions☆19Dec 10, 2025Updated 7 months ago
- ☆15Apr 22, 2026Updated 2 months ago