Curated collection of AI inference engineering resources — LLM serving, GPU kernels, quantization, distributed inference, and production deployment. Compiled from the AER Labs community.
☆297Feb 4, 2026Updated 7 months ago
Alternatives and similar repositories for ai-inference-resources
Users that are interested in ai-inference-resources are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆15Mar 11, 2026Updated 6 months ago
- [ACL'26 Workshop] KoViDoRe: Korean Visual Document Retrieval Benchmark☆26Jul 2, 2026Updated 2 months ago
- 🎹 Instruct.KR 2025 Summer Meetup: 오픈소스 LLM, vLLM으로 Production까지 🎹☆23Aug 2, 2025Updated last year
- A study assistant powered by Claude Opus. It provides various tools to assist with different tasks, such as researching,coding,note-takin…☆29Jul 18, 2024Updated 2 years ago
- 100 days of LLM inference engineering — daily posts, experiments, and visualizations☆1,226Apr 30, 2026Updated 4 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A curated resource list for learning AI performance engineering, from GPU fundamentals to production inference.☆2,741Aug 23, 2026Updated 3 weeks ago
- AI foundation and trend seminar tutorial with code☆24Apr 6, 2026Updated 5 months ago
- Become GPU kernel engineer step by step.☆65May 7, 2026Updated 4 months ago
- a personal collection of my notes for ml sys☆124Sep 1, 2026Updated last week
- prompt tuning, management, playground lab(w/ Python Streamlit, FastAPI)☆13Mar 14, 2025Updated last year
- AI 법률 어드바이저 모델 : KoAlpaca 모델에 생활법령 데이터를 학습시켜 LoRA finetuning & 생활 법령 100문 100답 데이터 2,195개를 스크랩 하여 LLM 학습을 위한 대화 형식의 json 파일로 제작☆14Feb 1, 2024Updated 2 years ago
- huggingface에 있는 한국어 데이터 세트☆38Oct 10, 2024Updated last year
- Tracing JIT Deep Learning Library☆31Nov 6, 2025Updated 10 months ago
- a whirlwind tour to deep learning and deep learning systems☆83Sep 2, 2026Updated last week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆16Aug 18, 2025Updated last year
- ☆16Jul 12, 2026Updated 2 months ago
- GPU Engineering for AI Systems☆596May 17, 2026Updated 3 months ago
- A Practitioner handbook for production llm serving.☆189Sep 5, 2026Updated last week
- Building a Production-Grade MCP Server Architecture with a Multi-Agent System☆63Apr 19, 2026Updated 4 months ago
- Pytorch를 활용한 WandB의 Sweeps 🧹☆15Dec 24, 2022Updated 3 years ago
- ☆30Jun 18, 2026Updated 2 months ago
- Production-grade engineering skills for AI coding agents.☆17Jun 12, 2026Updated 3 months ago
- Korean-MTEB☆106May 12, 2026Updated 4 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- NCCL communication API layer, and transport layer created from first principles.☆16Aug 20, 2025Updated last year
- ☆13Sep 16, 2019Updated 6 years ago
- Paper list and short/long summaries I've read for my research or interests☆23May 29, 2024Updated 2 years ago
- StrategyQA 데이터 세트 번역☆22Apr 12, 2024Updated 2 years ago
- 《표준국어대사전》 MCP 서버☆28Mar 29, 2026Updated 5 months ago
- Batched square compact-Householder QR factorization.☆15Jul 2, 2026Updated 2 months ago
- ☆44Aug 16, 2026Updated 3 weeks ago
- CLIcK: A Benchmark Dataset of Cultural and Linguistic Intelligence in Korean☆49Dec 23, 2024Updated last year
- LLM 모델의 외국어 토큰 생성을 막는 코드 구현☆87Aug 7, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Agent 개발 연구에 진심인 사람들의 성장과정☆21Jan 31, 2026Updated 7 months ago
- ☆13Nov 10, 2023Updated 2 years ago
- [ESWC '24] This repo is official implementation for the paper "Towards Harnessing Large Language Models as Autonomous Agents for Semantic…☆10May 25, 2024Updated 2 years ago
- ☆21Sep 30, 2025Updated 11 months ago
- openai-tutorial☆14Mar 5, 2023Updated 3 years ago
- OUR MATH HElping AGenT☆23Aug 25, 2025Updated last year
- ☆23Apr 16, 2026Updated 4 months ago