eLLM: Run Long-Horizon Inference Faster on CPUs Than on GPUs
☆602Nov 12, 2026Updated this week
Alternatives and similar repositories for eLLM
Users that are interested in eLLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Bridge incompatible embedding spaces with a single SVD. When your embedding provider deprecates a model, adapt instead of re-embedding.☆36Apr 28, 2026Updated 6 months ago
- Generalist Multitask Transformer Encoders☆136Nov 2, 2026Updated 2 weeks ago
- ☆45Jul 1, 2026Updated 4 months ago
- A small, production-oriented Voice Activity Detection project for training an efficient streaming VAD model from scratch, with synthetic …☆17Jul 25, 2026Updated 3 months ago
- ☆2,800Jul 27, 2026Updated 3 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Claude Code ZeroClaw Pro 2026: AI Multitool & CLI Router for Claude SDK Subagents☆52Updated this week
- LMCache: Supercharge Your LLM with the Fastest KV Cache Layer☆12,367Updated this week
- A 15M parameter character LLM trained to survive in an empty world with only a pigeon for company.☆21May 5, 2026Updated 6 months ago
- Lucebox inference engine for heterogeneous hardware & consumer GPUs☆3,007Updated this week
- From-scratch multi-GPU LLM inference engine: paged KV cache, continuous batching, prefix caching, tensor parallelism, OpenAI-compatible s…☆28Sep 25, 2026Updated last month
- ☆47Aug 3, 2026Updated 3 months ago
- the agi compiler: records llm agent behavior, proves what repeats, and compiles it into verified, sandboxed wasm binaries that run for mi…☆131Jul 7, 2026Updated 4 months ago
- git diff for knowledge graphs: semantic, visual diff and review for RDF, OBO and JSON graphs☆59Updated this week
- Custom HIP inference engine for AMD MI50/MI60 (gfx906)☆20Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Speculative Decoding Implementations: MTP, EAGLE-3, Medusa-1, PARD, Draft Models, N-gram and Suffix Decoding from scratch☆15May 2, 2026Updated 6 months ago
- A curated resource list for learning AI performance engineering, from GPU fundamentals to production inference.☆4,369Oct 17, 2026Updated 3 weeks ago
- Language model tokenization at GB/s☆4,155Nov 2, 2026Updated last week
- Proxima lets existing GPUs serve 4x more concurrent requests☆26Aug 19, 2026Updated 2 months ago
- A small Python library and CLI for working with Cloudflare Turnstile on your own pages - read the sitekey, build the token, verify the re…☆48Oct 12, 2026Updated last month
- A simulator for LLM Inference prefix cache☆77Updated this week
- ☆11Jul 4, 2026Updated 4 months ago
- DFlash: Block Diffusion for Flash Speculative Decoding☆6,238Aug 18, 2026Updated 2 months ago
- Run stock llama.cpp with the stock Unsloth Qwen3.6-35B-A3B 4-bit on a 16 GB Mac.☆14Nov 6, 2026Updated last week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- BROKEN REPO. DO NOT USE UNDER ANY CIRCUMSTANCES☆20Oct 13, 2026Updated last month
- Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond☆2,041Updated this week
- htop for your local AI☆13Updated this week
- FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.☆17,215Updated this week
- Universal cognitive engine for AI. Features autonomy, self-reflection, and continuous learning via the Nine Questions loop.☆14Jun 13, 2026Updated 5 months ago
- A vector index built on TurboQuant, written in Rust with Python bindings☆17,496Oct 7, 2026Updated last month
- Adaptive Chunking: automatically select the best chunking method per document for RAG. Accepted at LREC 2026.☆404Jul 6, 2026Updated 4 months ago
- IntelliKit is a collection of intelligent tools designed to make GPU kernel development, profiling, and validation accessible to LLMs and…☆38Updated this week
- Impulse by Velocity: run AI models on your own computer, on Windows and Linux. Load any GGUF model and chat with web search, files, chart…☆35Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A high-performance inference engine for AI models☆3,348Updated this week
- Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.☆79,551Updated this week
- An agent harness that compiles a model into one provably-correct, self-retargeting CUDA megakernel and self-tunes it past cuBLAS at batch…☆163Sep 18, 2026Updated last month
- Minimal, zero-dependency LLM inference in pure C11. CPU-first with NEON/AVX2 SIMD. Flash MoE (pread + LRU expert cache). TurboQuant 3-bit…☆31Sep 19, 2026Updated last month
- A decision-model-based ontology & knowledge-graph builder — builds governed knowledge graphs from your documents, every fact gated and tr…☆283Updated this week
- local-first Benchmark Harness for LLM agents — resumable · process-isolated · proxy metrics☆13Sep 26, 2026Updated last month
- ☆27Sep 11, 2026Updated 2 months ago
Are these results useful?