Curated collection of AI inference engineering resources — LLM serving, GPU kernels, quantization, distributed inference, and production deployment. Compiled from the AER Labs community.
☆326Feb 4, 2026Updated 7 months ago
Alternatives and similar repositories for ai-inference-resources
Users that are interested in ai-inference-resources are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ACL'26 Workshop] KoViDoRe: Korean Visual Document Retrieval Benchmark☆27Jul 2, 2026Updated 3 months ago
- 🎹 Instruct.KR 2025 Summer Meetup: 오픈소스 LLM, vLLM으로 Production까지 🎹☆23Aug 2, 2025Updated last year
- A curated resource list for learning AI performance engineering, from GPU fundamentals to production inference.☆3,946Sep 12, 2026Updated 3 weeks ago
- 100 days of LLM inference engineering — daily posts, experiments, and visualizations☆1,798Apr 30, 2026Updated 5 months ago
- A curated list of awesome papers about utilizing large language models for ranking.☆32Apr 12, 2026Updated 5 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- ☆11Mar 12, 2025Updated last year
- A lightweight application to explore the mystery of the ISS.☆14Dec 16, 2022Updated 3 years ago
- AI foundation and trend seminar tutorial with code☆24Apr 6, 2026Updated 5 months ago
- ☆19May 16, 2024Updated 2 years ago
- Become GPU kernel engineer step by step.☆70May 7, 2026Updated 4 months ago
- a personal collection of my notes for ml sys☆124Sep 1, 2026Updated last month
- prompt tuning, management, playground lab(w/ Python Streamlit, FastAPI)☆13Mar 14, 2025Updated last year
- Evaluate gpt-4o on CLIcK (Korean NLP Dataset)☆20May 18, 2024Updated 2 years ago
- AI 법률 어드바이저 모델 : KoAlpaca 모델에 생활법령 데이터를 학습시켜 LoRA finetuning & 생활 법령 100문 100답 데이터 2,195개를 스크랩 하여 LLM 학습을 위한 대화 형식의 json 파일로 제작☆14Sep 20, 2026Updated last week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- huggingface에 있는 한국어 데이터 세트☆38Oct 10, 2024Updated last year
- It's for SK Networks AI 1☆15Oct 24, 2024Updated last year
- ☆16Aug 18, 2025Updated last year
- GPU Engineering for AI Systems☆598May 17, 2026Updated 4 months ago
- A Practitioner handbook for production llm serving.☆203Sep 5, 2026Updated 3 weeks ago
- Building a Production-Grade MCP Server Architecture with a Multi-Agent System☆66Apr 19, 2026Updated 5 months ago
- PyTorch compiler and WebGPU runtime☆27Apr 14, 2026Updated 5 months ago
- Pytorch를 활용한 WandB의 Sweeps 🧹☆15Dec 24, 2022Updated 3 years ago
- Production-grade engineering skills for AI coding agents.☆17Jun 12, 2026Updated 3 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Korean-MTEB☆106May 12, 2026Updated 4 months ago
- NCCL communication API layer, and transport layer created from first principles.☆16Aug 20, 2025Updated last year
- Paper list and short/long summaries I've read for my research or interests☆23May 29, 2024Updated 2 years ago
- 🔎 KURE: Korea University Retrieval Embedding models☆233Sep 7, 2026Updated 3 weeks ago
- Batched square compact-Householder QR factorization.☆15Jul 2, 2026Updated 3 months ago
- MLIR-based partitioning system☆213Updated this week
- CLIcK: A Benchmark Dataset of Cultural and Linguistic Intelligence in Korean (LREC-COLING 2024)☆49Dec 23, 2024Updated last year
- ☆45Mar 17, 2026Updated 6 months ago
- Agent 개발 연구에 진심인 사람들의 성장과정☆21Jan 31, 2026Updated 8 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆17Jan 26, 2024Updated 2 years ago
- [ESWC '24] This repo is official implementation for the paper "Towards Harnessing Large Language Models as Autonomous Agents for Semantic…☆10May 25, 2024Updated 2 years ago
- ☆21Sep 30, 2025Updated last year
- ☆68Feb 6, 2026Updated 7 months ago
- ☆24Apr 16, 2026Updated 5 months ago
- <머신러닝 도감> 리포지토리☆10Dec 18, 2019Updated 6 years ago
- Statistics and Visualization of acceptance rate, main keyword of CVPR 2023 accepted papers for the main Computer Vision conference (CVPR)☆13May 4, 2023Updated 3 years ago