LLM inference in C, compiled per model and per chip. Up to 14x faster.
☆28Sep 7, 2026Updated last month
Alternatives and similar repositories for llm-in-c
Users that are interested in llm-in-c are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This project demonstrates the application of Hybrid Markov Logic Networks (MLN) to verify and refine embeddings from the Cora citation ne…☆16Apr 18, 2025Updated last year
- ☆27Oct 12, 2026Updated last week
- MLX (Apple Silicon) port of MiniMax-H3 — 33B joint video+audio diffusion. Validated against the diffusers reference; AdaLN precompute dro…☆28Oct 8, 2026Updated last week
- AVX-512 fused NF4 dequantization + matrix multiplication for local LLM inference.☆14Mar 6, 2026Updated 7 months ago
- Qwen3.8-27B on one laptop CPU: up to 2.52 token/s, 8 GB tested, no runtime accuracy loss. Native OpenAI-compatible API with function tool…☆21Sep 9, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Qwen3.8-27b and Qwen3.6-35B-A3B local inference engine for Vulkan and Metal☆71Updated this week
- Low-level Metal inference engine for Apple M4: universal quant formats at MLX parity, 1M-token out-of-core contexts, and speculative deco…☆26Sep 5, 2026Updated last month
- Work with Pi☆15Feb 9, 2026Updated 8 months ago
- Run local image, text, speech, vision, music, and video workflows, plus model management and a loopback OpenAI-compatible API server. The…☆83Updated this week
- Introduce some smooth and free android emulator for develop. （开发神器 — 一些免费流畅的Android模拟器）☆14Apr 30, 2015Updated 11 years ago
- A tool for semi-autonomous scientific research and discovery.☆36Oct 1, 2026Updated 2 weeks ago
- 🧠 Data-driven head model individualization from digitized electrode positions or photogrammetry for improved M/EEG source localization a…☆18Sep 5, 2026Updated last month
- ☆11Jul 1, 2022Updated 4 years ago
- A GPSD simulator using a map☆11Feb 22, 2018Updated 8 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- State-of-the-art, developer-friendly, open-source move testing framework.☆17Aug 16, 2026Updated 2 months ago
- Source code for XTRIDE: "Practical Type Inference: High-Throughput Recovery of Real-World Structures and Function Signatures"☆26Jun 24, 2026Updated 3 months ago
- Shiftly is an Android app which provides an easy and interactive way for both employers and employees to manage scheduling at work.☆11Sep 24, 2019Updated 7 years ago
- static embedding models in golang☆21Oct 10, 2026Updated last week
- Fork of qemu android emulator with aarch64 support.☆22Aug 21, 2019Updated 7 years ago
- c sharp A-Star Graph traversal algorithm implementation☆10Jan 14, 2020Updated 6 years ago
- A ternary numeral system (base 3) that uses a balanced signed-digit representation : −, 0, and +.☆12Jun 13, 2025Updated last year
- RLM (Recursive Language Model) extension for pi - process large context files that exceed LLM context windows☆20Feb 8, 2026Updated 8 months ago
- Educational distributed training and inference library for heterogeneous local hardware: Mac minis, Raspberry Pis and GPUs over plain Pyt…☆90Oct 7, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Iris-3B pixel-space text-to-image on Apple Silicon GPUs: Metal-optimized engine, native macOS app, CLI, Python and local HTTP API☆56Updated this week
- ChanLun (缠论) trade signal workbench — BTC/USDT stroke/center/buy-sell point detection with OKX public market data and TradingView fronten…☆24Jul 17, 2026Updated 3 months ago
- Accompanying code for the paper "Learning Causal Models Online"☆23Jul 14, 2020Updated 6 years ago
- A python implementation of the ABC sofware metric.☆11Jan 2, 2026Updated 9 months ago
- 📝 Form validation and UI components for Godot Engine☆12Feb 18, 2024Updated 2 years ago
- LibreWinForms: cross-platform WinForms-shaped APIs and SDK backed by ProGPU/Silk.NET.☆39Updated this week
- MiniMax-H3 on single DGX Spark: keys Sol-Engine ports + Heretic TE + Spectrum/Sage speed + 0.5MP upscaler finish. Formal bench included.☆49Aug 23, 2026Updated last month
- An Earley parser in C#☆10Sep 18, 2010Updated 16 years ago
- ROS package to allow starting and stopping of rosbag recordings via service calls.☆10Mar 5, 2018Updated 8 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- C# Implementation of Finger Tree☆13Mar 28, 2017Updated 9 years ago
- Native Rust inference server for open models on NVIDIA and Apple Silicon. OpenAI- and Anthropic-compatible APIs, GGUF + safetensors + MLX…☆136Updated this week
- GUI designer for BeOS.☆13Dec 8, 2019Updated 6 years ago
- Links to all the source code and solutions I reference in my O'Reilly Introduction to Docker video tutorial☆11Dec 10, 2014Updated 11 years ago
- ☆24May 9, 2026Updated 5 months ago
- Put an LLM in your shell scripts and command-line pipelines. Dead simple.☆12Jan 23, 2026Updated 8 months ago
- A Hebrew Analytical Lexicon based on ETCBC (4c) data☆12Oct 1, 2019Updated 7 years ago