From-scratch multi-GPU LLM inference engine: paged KV cache, continuous batching, prefix caching, tensor parallelism, OpenAI-compatible server. Custom Triton kernels, vLLM-class throughput.
☆28Sep 25, 2026Updated last month
Alternatives and similar repositories for CoreLLM
Users that are interested in CoreLLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Free Flow automatically connects you to the BEST + FREE LLMs so you can stop juggling API keys, rate limits and kidney sales so you can s…☆12Jun 11, 2025Updated last year
- a personal collection of my notes for ml sys☆127Oct 26, 2026Updated 2 weeks ago
- FP8 quantization + vLLM serving of pipecat-ai/phonellm-alpha-1 on Modal☆17Aug 28, 2026Updated 2 months ago
- Puzzles/etudes for JAX/TPU kernel language☆22Mar 31, 2026Updated 7 months ago
- Stanford CUDA Course Materials Import☆10Jun 8, 2015Updated 11 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A practical, step-by-step guide to building and training a Large Language Model from scratch, from data collection and tokenization to tr…☆14Oct 31, 2026Updated last week
- ☆10Sep 9, 2025Updated last year
- ☆32Sep 16, 2023Updated 3 years ago
- ☆13Jul 24, 2025Updated last year
- Very minimal implementation of DEER☆14Jul 6, 2026Updated 4 months ago
- CUDA optimization ladders you can learn from: GEMM from naive to Tensor Cores and Hopper WGMMA vs cuBLAS, reductions, scans, sorts, Flash…☆17Oct 8, 2026Updated last month
- Tiny-MoE is a lightweight Mixture-of-Experts language model built entirely from scratch in native PyTorch and trained end-to-end on Kaggl…☆22Sep 24, 2026Updated last month
- Blockchain Technologies - The course is divided into [6 modules]: 1. Distributed Systems & Consensus, 2. Cryptoeconomics & Proof-of-Stake…☆15Jul 9, 2026Updated 4 months ago
- A structured Machine Learning learning & revision repository with hands-on notebooks, practical examples, and quick reference guides for …☆15Jul 21, 2026Updated 3 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- ☆17May 6, 2025Updated last year
- [MIA 2025]: A New Dataset and Versatile Multi-Task Surgical Workflow Analysis Framework for Thoracoscopic Mitral Valvuloplasty☆15Aug 11, 2025Updated last year
- The Python Harness for Production AI Multi-Agent Systems☆63May 18, 2026Updated 5 months ago
- The highest-scoring AI memory system ever benchmarked. And it's free.☆59Apr 7, 2026Updated 7 months ago
- This is a Python-based Discord bot for the IIT Madras BS Students Discord server.☆22Jun 2, 2024Updated 2 years ago
- Full pipeline for building LLM, including pretrain, instruction tuning with RLHF, DPO, and distillation☆15Aug 14, 2026Updated 2 months ago
- A Model Context Protocol server that provides package index querying capabilities.☆11Oct 25, 2026Updated 2 weeks ago
- Give the agent a cage, not your keys. One-command Docker sandbox for AI coding agents: full autonomous permissions, per-project isolation…☆18Oct 3, 2026Updated last month
- Open-source engine reimplementation of Total Annihilation: Kingdoms (C11, native + WebAssembly). Bring your own game files.☆15Updated this week
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Public repository for CleANN, an efficient fully-dynamic approximate nearest neighbor search index☆19Sep 18, 2025Updated last year
- Experimenting with database engines and related structures, algorithms and concepts.☆16Feb 15, 2026Updated 8 months ago
- ☆23Aug 17, 2021Updated 5 years ago
- Building an LLM inference engine from scratch☆29Jul 18, 2026Updated 3 months ago
- SImple profiler for Löve2D framework, outputs data to canvas and/or terminal.☆13Aug 15, 2024Updated 2 years ago
- A KEDA external scaler for the Durable Task Azure Storage backend.☆10Updated this week
- Python package for processing deep learning models☆16Dec 12, 2025Updated 10 months ago
- Master's thesis project at Chalmers University of Technology, spring 2021. The work was a part of a larger project at Chalmers to develop…☆19Jun 1, 2021Updated 5 years ago
- End-to-end neural table-text understanding models.☆10Nov 11, 2020Updated 6 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Port of Final Fantasy III 3D Remake for Switch.☆16Nov 4, 2026Updated last week
- 🐐 AI-powered investment analysis using 5 legendary investor mental models (Buffett, Lynch, Graham, Munger, Dalio). Features time-travel …☆14Updated this week
- a fun and educational take on vLLM☆232Jan 25, 2026Updated 9 months ago
- A high performance NOSQL DBMS build upon B+trees, and index clustered storage☆14Jun 16, 2025Updated last year
- End-to-End Super Resolution Object Detection Networks☆12Jun 8, 2018Updated 8 years ago
- Build cross platform desktop app with Lua, MoonScript, and Layout Language☆18Sep 25, 2017Updated 9 years ago
- Abusing StepFunctions so that I do not have to write any Lambda code.☆15Sep 22, 2021Updated 5 years ago
Are these results useful?