Curated collection of AI inference engineering resources — LLM serving, GPU kernels, quantization, distributed inference, and production deployment. Compiled from the AER Labs community.
☆277Feb 4, 2026Updated 6 months ago
Alternatives and similar repositories for ai-inference-resources
Users that are interested in ai-inference-resources are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆15Mar 11, 2026Updated 5 months ago
- 100 days of LLM inference engineering — daily posts, experiments, and visualizations☆891Apr 30, 2026Updated 3 months ago
- A study assistant powered by Claude Opus. It provides various tools to assist with different tasks, such as researching,coding,note-takin…☆29Jul 18, 2024Updated 2 years ago
- A curated resource list for learning AI performance engineering, from GPU fundamentals to production inference.☆1,466Updated this week
- A curated list of awesome papers about utilizing large language models for ranking.☆32Apr 12, 2026Updated 4 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆11Mar 12, 2025Updated last year
- vLLM Daily Summarization of Merged PRs☆53Aug 15, 2026Updated last week
- Become GPU kernel engineer step by step.☆64May 7, 2026Updated 3 months ago
- a personal collection of my notes for ml sys☆120Aug 8, 2026Updated 2 weeks ago
- Evaluate gpt-4o on CLIcK (Korean NLP Dataset)☆20May 18, 2024Updated 2 years ago
- prompt tuning, management, playground lab(w/ Python Streamlit, FastAPI)☆13Mar 14, 2025Updated last year
- huggingface에 있는 한국어 데이터 세트☆37Oct 10, 2024Updated last year
- VectraDB is an in-memory, high performance vector database written in Go.☆33Jun 21, 2026Updated 2 months ago
- a whirlwind tour to deep learning and deep learning systems☆82Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- GPU Engineering for AI Systems☆590May 17, 2026Updated 3 months ago
- ☆16Aug 18, 2025Updated last year
- ☆16Jul 12, 2026Updated last month
- A Practitioner handbook for production llm serving.☆169Aug 5, 2026Updated 2 weeks ago
- Building a Production-Grade MCP Server Architecture with a Multi-Agent System☆61Apr 19, 2026Updated 4 months ago
- PyTorch compiler and WebGPU runtime☆26Apr 14, 2026Updated 4 months ago
- Pytorch를 활용한 WandB의 Sweeps 🧹☆15Dec 24, 2022Updated 3 years ago
- ☆29Jun 18, 2026Updated 2 months ago
- Production-grade engineering skills for AI coding agents.☆17Jun 12, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Korean-MTEB☆104May 12, 2026Updated 3 months ago
- NCCL communication API layer, and transport layer created from first principles.☆16Aug 20, 2025Updated last year
- StrategyQA 데이터 세트 번역☆22Apr 12, 2024Updated 2 years ago
- Batched square compact-Householder QR factorization.☆15Jul 2, 2026Updated last month
- Coding-Insight is another KFASC project which recieved the Chairman's Award. It did not recieve the respect it got from the judges becaus…☆16Aug 18, 2024Updated 2 years ago
- CLIcK: A Benchmark Dataset of Cultural and Linguistic Intelligence in Korean☆48Dec 23, 2024Updated last year
- LLM 모델의 외국어 토큰 생성을 막는 코드 구현☆87Aug 7, 2025Updated last year
- [ESWC '24] This repo is official implementation for the paper "Towards Harnessing Large Language Models as Autonomous Agents for Semantic…☆10May 25, 2024Updated 2 years ago
- openai-tutorial☆14Mar 5, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- OUR MATH HElping AGenT☆23Aug 25, 2025Updated 11 months ago
- ☆68Feb 6, 2026Updated 6 months ago
- ☆22Apr 16, 2026Updated 4 months ago
- <머신러닝 도감> 리포지토리☆10Dec 18, 2019Updated 6 years ago
- Statistics and Visualization of acceptance rate, main keyword of CVPR 2023 accepted papers for the main Computer Vision conference (CVPR)☆13May 4, 2023Updated 3 years ago
- SRE Agent — An AI-powered MCP server for production incident triage. Takes natural-language symptom reports, plans structured investigati…☆36Mar 6, 2026Updated 5 months ago
- ☆40Dec 16, 2023Updated 2 years ago