100 days of LLM inference engineering — daily posts, experiments, and visualizations
☆934Apr 30, 2026Updated 4 months ago
Alternatives and similar repositories for 100-days-of-inference
Users that are interested in 100-days-of-inference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- VectraDB is an in-memory, high performance vector database written in Go.☆33Jun 21, 2026Updated 2 months ago
- Companion code for Grokking Megakernels: fuse an entire LLM forward pass into a single CUDA kernel☆28Feb 9, 2026Updated 6 months ago
- Auto-tuning for vllm. Getting the best performance out of your LLM deployment (vllm+guidellm+optuna)☆64Aug 19, 2026Updated last week
- Optimizing diffusion for production-ready speeds☆40Jan 10, 2026Updated 7 months ago
- A notebook based tutorial series on buildling a LLM from scratch☆27Sep 17, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- This repo is a collection of various PoCs (Proof-of-Concepts) to interface custom data using LLMs.☆65Aug 11, 2026Updated 2 weeks ago
- ☆45Mar 31, 2025Updated last year
- Ensemble wavelet based neural network for generating epidemiological forecasting (epicasting)☆15Sep 20, 2025Updated 11 months ago
- Data Portfolio☆11Jul 18, 2018Updated 8 years ago
- MINERVA - Minimal Inference Engine for Robust, Verifiable, and Authenticated ML. Encrypted, integrity-verified neural network inference f…☆59May 13, 2026Updated 3 months ago
- LiteGPT: A 124M Small Language Model (SLM) pre-trained on FineWeb and fine-tuned on Alpaca.☆35Dec 16, 2025Updated 8 months ago
- AI Workload Orchestrator for Kubernetes☆23Jul 10, 2026Updated last month
- ☆15Mar 11, 2026Updated 5 months ago
- This Repo consists the python note books of IITM - Mathematical Foundations for Generative AI Course,☆406Feb 17, 2026Updated 6 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆52Sep 29, 2025Updated 11 months ago
- Implementation of the CVPR2025 paper LoTUS: Large-Scale Machine Unlearning with a Taste of Uncertainty.☆22Sep 10, 2025Updated 11 months ago
- Generative AI / LLMs using Databricks Data Intelligence Platform☆15Jul 7, 2025Updated last year
- A curated resource list for learning AI performance engineering, from GPU fundamentals to production inference.☆2,190Aug 23, 2026Updated last week
- This repository contains the notes and code I have created for practice during my IITM BS in Programming and Data Science course.☆21Mar 11, 2026Updated 5 months ago
- Learn the building blocks of how to build DeepSeek from scratch.☆157May 9, 2026Updated 3 months ago
- Statistical modeling and Bayesian modeling by PyMC3, Stan and TensorFlow Probability☆23Dec 31, 2019Updated 6 years ago
- ☆59Apr 27, 2025Updated last year
- Learn how to write a package for Meteor.☆11Feb 15, 2017Updated 9 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- A written introduction to pytest☆14May 29, 2022Updated 4 years ago
- This hands-on walks you through fine-tuning an open source LLM on Azure and serving the fine-tuned model on Azure. It is intended for Dat…☆12Jun 23, 2024Updated 2 years ago
- qup: a Single-Node Job Scheduler with NVIDIA GPU support☆18Jan 10, 2023Updated 3 years ago
- A Chrome extension powered by Gemini Nano & Gemma 3 for offline learning, helping remote area students with AI chat, AI summary, and AI t…☆32Oct 31, 2025Updated 9 months ago
- Ultimate AI research and engineering course☆36Jul 21, 2025Updated last year
- ☆21Jul 3, 2025Updated last year
- Interactive version of the CuTe layout paper☆57Apr 14, 2026Updated 4 months ago
- ☆11Apr 25, 2021Updated 5 years ago
- Code, labs, and resources for O'Reilly AI Systems Performance Engineering: GPU optimization, distributed training, inference scaling, and…☆1,887Aug 21, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- All the solutions for the Sliding window Algorithms☆13May 5, 2022Updated 4 years ago
- 🌱 A little course on Reinforcement Learning Environments for evaluating and training Language Models☆223May 27, 2026Updated 3 months ago
- Notebooks for the DLP course by Prof.Mitesh Khapra and me, offered to IITM BS Students.☆24May 21, 2025Updated last year
- Tutorials on how to Query Data☆13Jan 7, 2023Updated 3 years ago
- Evaluate gpt-4o on CLIcK (Korean NLP Dataset)☆20May 18, 2024Updated 2 years ago
- Relevance Prediction in E-commerce Product Search☆20Sep 27, 2025Updated 11 months ago
- Perplexity Lite using Langgraph, Tavily, and GPT-4.☆14Jan 11, 2024Updated 2 years ago