100 days of LLM inference engineering — daily posts, experiments, and visualizations
☆1,489Apr 30, 2026Updated 4 months ago
Alternatives and similar repositories for 100-days-of-inference
Users that are interested in 100-days-of-inference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Tracing JIT Deep Learning Library☆31Nov 6, 2025Updated 10 months ago
- Curated collection of AI inference engineering resources — LLM serving, GPU kernels, quantization, distributed inference, and production …☆310Feb 4, 2026Updated 7 months ago
- Companion code for Grokking Megakernels: fuse an entire LLM forward pass into a single CUDA kernel☆30Feb 9, 2026Updated 7 months ago
- A lightweight, interactive GIS + Graph-based map viewer for spatial exploration and supply chain intelligence.☆24Aug 29, 2026Updated 3 weeks ago
- Become GPU kernel engineer step by step.☆67May 7, 2026Updated 4 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Test LLMs automatically with Giskard and CI/CD☆31Aug 7, 2024Updated 2 years ago
- ☆21Apr 27, 2026Updated 4 months ago
- Optimizing diffusion for production-ready speeds☆40Jan 10, 2026Updated 8 months ago
- A notebook based tutorial series on buildling a LLM from scratch☆27Sep 17, 2024Updated 2 years ago
- This repo is a collection of various PoCs (Proof-of-Concepts) to interface custom data using LLMs.☆65Updated this week
- ☆45Mar 31, 2025Updated last year
- GPU Engineering for AI Systems☆596May 17, 2026Updated 4 months ago
- This is a web app that forecasts the High and Low of the stocks, built using streamlit, and based on statsmodels, sklearn, and sktime.☆12Nov 19, 2021Updated 4 years ago
- A curated resource list for learning AI performance engineering, from GPU fundamentals to production inference.☆3,210Sep 12, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Two Day Azure ML Bootcamp☆11Jul 30, 2023Updated 3 years ago
- Hub for researchers exploring VLMs and Multimodal Learning:)☆64Mar 24, 2026Updated 5 months ago
- Code, labs, and resources for O'Reilly AI Systems Performance Engineering: GPU optimization, distributed training, inference scaling, and…☆1,963Updated this week
- AI Workload Orchestrator for Kubernetes☆25Updated this week
- ☆19Aug 23, 2025Updated last year
- 💙 Unstructured Data Connectors for Haystack 2.0☆18Sep 21, 2023Updated 2 years ago
- ☆55Sep 29, 2025Updated 11 months ago
- Complete System Design Case Studies☆35Jan 27, 2024Updated 2 years ago
- Learn LLM internals step by step - from tokenization to attention to inference optimization.☆1,627Sep 1, 2026Updated 2 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Making More of Little Data: Improving Low-Resource Automatic Speech Recognition Using Data Augmentation☆17May 17, 2023Updated 3 years ago
- Implementation of the CVPR2025 paper LoTUS: Large-Scale Machine Unlearning with a Taste of Uncertainty.☆23Sep 10, 2025Updated last year
- To forecast the sales for the most consistently profitable market-segment.☆16Jul 24, 2021Updated 5 years ago
- Created a Flask API🚀 which can detect toxicity in comment(text)💭 using NLP-BERT🤖. Following MLOps lifecycle🔁 to deploy ML system in p…☆14Jan 23, 2023Updated 3 years ago
- Koa.js framework setup to run within Next.js API routes.☆11Jul 27, 2026Updated last month
- Learn the building blocks of how to build DeepSeek from scratch.☆167May 9, 2026Updated 4 months ago
- Open AI APIs with Llama Index and Milvus Vector DB for Retrieval Augmented Generation (RAG) testing☆12Jan 27, 2024Updated 2 years ago
- Perform visual question answering on your images☆19May 8, 2024Updated 2 years ago
- ☆24Nov 7, 2022Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A good book, uploaded for myself and those who are interested.☆14May 6, 2022Updated 4 years ago
- ☆59Apr 27, 2025Updated last year
- This repository contains a diverse collection of case studies and use cases commonly asked in data science interviews across different co…☆21Apr 14, 2024Updated 2 years ago
- LLM Workshop 2024☆17Jul 3, 2025Updated last year
- A Python wrapper for libhackrf☆12Jul 10, 2023Updated 3 years ago
- FlaskRestful + Swagger UI + Docker Compose + Unit Test | How to organize Python Code for REST API☆14Jun 5, 2022Updated 4 years ago
- ☆51Aug 17, 2026Updated last month