Building an LLM inference engine from scratch
☆29Jul 18, 2026Updated 3 months ago
Alternatives and similar repositories for nano-vllm
Users that are interested in nano-vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- CuratorKIT : Data curation and synthetic data generation for LLM post-training.☆31Oct 13, 2026Updated 2 weeks ago
- Latent Mamba Operator for Partial Differential Equations☆17Jun 3, 2025Updated last year
- An external memory for LLMs: a bi-temporal knowledge graph with hybrid (keyword + vector) retrieval and a self-improving reflection loop.…☆22Oct 18, 2026Updated last week
- DL Backtrace is a new explainablity technique for deep learning models that works for any modality and model type.☆28May 13, 2026Updated 5 months ago
- Aligntune : A Modular Toolkit for Post Training Alignment of LLMs☆45Updated this week
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- XoRL☆51Sep 5, 2026Updated last month
- ☆121Sep 10, 2026Updated last month
- Async value functions and replay-buffer critic training for PRIME-RL☆21Sep 4, 2026Updated last month
- Full pipeline for building LLM, including pretrain, instruction tuning with RLHF, DPO, and distillation☆15Aug 14, 2026Updated 2 months ago
- A vector field rendering library☆17Jul 31, 2019Updated 7 years ago
- ☆17Aug 22, 2026Updated 2 months ago
- ☆21Apr 22, 2026Updated 6 months ago
- ☆17Aug 12, 2026Updated 2 months ago
- Reproducing GPT-2 (124M) model on Indic language datasets☆13May 8, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- High-performance GEMM implementation optimized for NVIDIA H100 GPUs, leveraging Hopper architecture's TMA, WGMMA, and Thread Block Cluste…☆11Aug 25, 2026Updated 2 months ago
- ☆14Dec 22, 2024Updated last year
- 2014: Variational Monte Carlo for the harmonic oscillator, helium, hydrogen and H2 - IPython notebook and FORTRAN90☆14Jun 23, 2016Updated 10 years ago
- Discover, evaluate, and intervene on circuits in transformer models.☆29Oct 8, 2026Updated 3 weeks ago
- A hardware hybrid scheduling tensor engine. Improves performace by 35% for medium workload compared to pure GPU.☆13Jun 22, 2026Updated 4 months ago
- The MATH training dataset without MATH-500 test portion☆16Dec 20, 2025Updated 10 months ago
- stable diffusion using pytorch only☆11Apr 29, 2026Updated 6 months ago
- This is the official repo of "Scaling Recurrent Neural Networks to a Billion Parameters with Zero-Order Optimization"☆14Jan 8, 2026Updated 9 months ago
- Implementation of the Benchmark Approaches for Medical Instructional Video Classification (MedVidCL) and Medical Video Question Answering…☆31Jan 31, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Generating Summaries with Controllable Readability Levels (EMNLP 2023)☆15Jul 2, 2026Updated 3 months ago
- Experiments Notebook of "Understanding the Skill Gap in Recurrent Language Models: The Role of the Gather-and-Aggregate Mechanism"☆17Apr 30, 2025Updated last year
- Fast SGEMM emulation on Tensor Cores☆17Feb 16, 2025Updated last year
- FlashPrefill V2: Block-Sparse Prefill Attention for Long-Context LLM Serving☆32Aug 28, 2026Updated 2 months ago
- A meta-harness for Google Gemini 3: An agentic web UI with tool use and reasoning visualization, built by an AI agent.☆14Nov 24, 2025Updated 11 months ago
- This project applies multiple deep learning models to the problem of restoring diacritical marks to sentences in Vietnamese.☆25Nov 13, 2018Updated 7 years ago
- GStar Bootcamp - Assignment 1☆21Sep 8, 2025Updated last year
- ☆24Jan 14, 2025Updated last year
- ☆11Oct 15, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆12Dec 30, 2020Updated 5 years ago
- Preserving Generalization of Language Models in Few-shot Continual Relation Extraction (EMNLP2024)☆17Nov 21, 2024Updated last year
- [ACL 2024 Findings] Official code and data for ACL-2024 paper "X-Instruction: Aligning Language Model in Low-resource Languages with Self…☆10Jun 19, 2024Updated 2 years ago
- Made a CPU in Logisim when I was 14 (2009), and wrote a naive assembler and compiler for it in Flash. The CPU's design is inspired by Don…☆10Sep 30, 2016Updated 10 years ago
- Conversion from T1 to T2 MRI☆19Jan 19, 2026Updated 9 months ago
- Real-space parallel density matrix renormalization group (DMRG) based on ITensor☆20Dec 22, 2020Updated 5 years ago
- original 8bit CPU of ICF3-Z☆12Feb 20, 2020Updated 6 years ago