~950 line, minimal, extensible LLM inference engine built from scratch.
☆477Jan 9, 2026Updated 5 months ago
Alternatives and similar repositories for simple-llm
Users that are interested in simple-llm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- in this repository, i'm going to implement increasingly complex llm inference optimizations☆85May 22, 2025Updated last year
- ☆15Nov 18, 2025Updated 7 months ago
- [ICLR'26] "Nabla-Reasoner: LLM Reasoning via Test-Time Gradient Descent in Latent Space" by Peihao Wang*, Ruisi Cai*, Zhen Wang, Hongyuan…☆35Mar 10, 2026Updated 3 months ago
- Tiny evaluation of leading LLMs on competitive programming problems☆14Apr 10, 2026Updated 2 months ago
- Automatically rename research papers, ebooks, and PDFs.☆14Oct 26, 2016Updated 9 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Continual Learning Bench☆169Jun 8, 2026Updated 3 weeks ago
- Scripts for training Qwen 2.5 VL with ms-swift and GRPO☆12Feb 27, 2025Updated last year
- 📝The official repository of "Rethinking Cross-Generator Image Forgery Detection through DINOv3"☆25Dec 2, 2025Updated 6 months ago
- KV Cache & LoRA for minGPT☆61Mar 4, 2026Updated 3 months ago
- Official repo for UAE☆205Jun 21, 2026Updated last week
- GEMV implementation with CUTLASS☆21Aug 21, 2025Updated 10 months ago
- ☆34Jul 15, 2025Updated 11 months ago
- Storing long contexts in tiny caches with self-study☆281Mar 23, 2026Updated 3 months ago
- ☆39Feb 18, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Load and run Llama from safetensors files in C☆15Oct 24, 2024Updated last year
- Example repo showcasing model training and deployment with distil claude cli skill☆54Jan 19, 2026Updated 5 months ago
- ExpertFingerprinting: Behavioral Pattern Analysis and Specialization Mapping of Experts in GPT-OSS-20B's Mixture-of-Experts Architecture☆27Feb 3, 2026Updated 4 months ago
- Anatomy of High-Performance GEMM with Online Fault Tolerance on GPUs☆14Apr 3, 2025Updated last year
- RWKV, in easy to read code☆73Mar 25, 2025Updated last year
- code for training & evaluating Contextual Document Embedding models☆206May 14, 2025Updated last year
- Adding Marimo to Datasette☆21Mar 24, 2025Updated last year
- NanoGPT (124M) in 90 seconds☆5,438Jun 21, 2026Updated last week
- One-Pixel Shortcut: on the Learning Preference of Deep Neural Networks (ICLR 2023 Spotlight)☆14Sep 28, 2025Updated 9 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆13Nov 30, 2022Updated 3 years ago
- Transformer Architecture written with CUDA, C++ and LibTorch.☆10Jul 26, 2025Updated 11 months ago
- General-purpose planning and execution harness for LLMs — structured phases, critique, gating, and review☆94Updated this week
- Repository for the implementation and evaluation of DD-GloVe, a train-time debiasing algorithm to learn GloVe word embeddings by leveragi…☆13May 29, 2022Updated 4 years ago
- ☆155Mar 31, 2026Updated 3 months ago
- A terminal-based AI assistant for Linux sysadmins.☆39May 22, 2026Updated last month
- AI-Driven Research Systems (ADRS)☆144Dec 17, 2025Updated 6 months ago
- JAX Implementations of Descript Audio Codec and EnCodec☆37Mar 30, 2025Updated last year
- Tools to make language models a bit easier to use☆67Updated this week
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Text Normalization utilities for normalizing text for TTS☆22Mar 4, 2026Updated 3 months ago
- Unofficial Placement information bulletin for Manipal Institute of Technology☆10Jan 5, 2024Updated 2 years ago
- [CHIL 2024] Interpretation of Intracardiac Electrograms Through Textual Representations☆12Sep 4, 2024Updated last year
- [TMI' 23] FedDM: Federated Weakly Supervised Segmentation via Annotation Calibration and Gradient De-conflicting☆14Mar 11, 2023Updated 3 years ago
- Code for the WWW'23 paper "Sanitizing Sentence Embeddings (and Labels) for Local Differential Privacy"☆12Feb 20, 2023Updated 3 years ago
- ☆20May 30, 2024Updated 2 years ago
- [TACL/EMNLP'24] Do Vision and Language Models Share Concepts? A Vector Space Alignment Study☆16Nov 22, 2024Updated last year