Curated collection of AI inference engineering resources — LLM serving, GPU kernels, quantization, distributed inference, and production deployment. Compiled from the AER Labs community.
☆259Feb 4, 2026Updated 6 months ago
Alternatives and similar repositories for ai-inference-resources
Users that are interested in ai-inference-resources are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆15Mar 11, 2026Updated 4 months ago
- [ACL'26 Workshop] KoViDoRe: Korean Visual Document Retrieval Benchmark☆24Jul 2, 2026Updated last month
- 🎹 Instruct.KR 2025 Summer Meetup: 오픈소스 LLM, vLLM으로 Production까지 🎹☆23Aug 2, 2025Updated last year
- A study assistant powered by Claude Opus. It provides various tools to assist with different tasks, such as researching,coding,note-takin…☆28Jul 18, 2024Updated 2 years ago
- A curriculum for learning about gpu performance engineering, from scratch to what the frontier AI labs do☆1,278Apr 27, 2026Updated 3 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A curated list of awesome papers about utilizing large language models for ranking.☆32Apr 12, 2026Updated 3 months ago
- ☆11Mar 12, 2025Updated last year
- A lightweight application to explore the mystery of the ISS.☆14Dec 16, 2022Updated 3 years ago
- AI foundation and trend seminar tutorial with code☆24Apr 6, 2026Updated 3 months ago
- vLLM Daily Summarization of Merged PRs☆52Updated this week
- a personal collection of my notes for ml sys☆113Updated this week
- prompt tuning, management, playground lab(w/ Python Streamlit, FastAPI)☆13Mar 14, 2025Updated last year
- AI 법률 어드바이저 모델 : KoAlpaca 모델에 생활법령 데이터를 학습시켜 LoRA finetuning & 생활 법령 100문 100답 데이터 2,195개를 스크랩 하여 LLM 학습을 위한 대화 형식의 json 파일로 제작☆14Feb 1, 2024Updated 2 years ago
- a whirlwind tour to deep learning and deep learning systems☆81Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- GPU Engineering for AI Systems☆551May 17, 2026Updated 2 months ago
- ☆16Aug 18, 2025Updated 11 months ago
- ☆16Jul 12, 2026Updated 3 weeks ago
- A Practitioner handbook for production llm serving.☆155Updated this week
- Building a Production-Grade MCP Server Architecture with a Multi-Agent System☆53Apr 19, 2026Updated 3 months ago
- PyTorch compiler and WebGPU runtime☆26Apr 14, 2026Updated 3 months ago
- Pytorch를 활용한 WandB의 Sweeps 🧹☆15Dec 24, 2022Updated 3 years ago
- Korean-MTEB☆100May 12, 2026Updated 2 months ago
- NCCL communication API layer, and transport layer created from first principles.☆16Aug 20, 2025Updated 11 months ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- ☆13Sep 16, 2019Updated 6 years ago
- Paper list and short/long summaries I've read for my research or interests☆23May 29, 2024Updated 2 years ago
- StrategyQA 데이터 세트 번역☆22Apr 12, 2024Updated 2 years ago
- KURE: 고려대학교에서 개발한, 한국어 검색에 특화된 임베딩 모델☆227Apr 14, 2026Updated 3 months ago
- 《표준국어대사전》 MCP 서버☆26Mar 29, 2026Updated 4 months ago
- Batched square compact-Householder QR factorization.☆15Jul 2, 2026Updated last month
- MLIR-based partitioning system☆202Updated this week
- Coding-Insight is another KFASC project which recieved the Chairman's Award. It did not recieve the respect it got from the judges becaus…☆16Aug 18, 2024Updated last year
- ☆35Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- CLIcK: A Benchmark Dataset of Cultural and Linguistic Intelligence in Korean☆48Dec 23, 2024Updated last year
- LLM 모델의 외국어 토큰 생성을 막는 코드 구현☆87Aug 7, 2025Updated 11 months ago
- Agent 개발 연구에 진심인 사람들의 성장과정☆21Jan 31, 2026Updated 6 months ago
- [ESWC '24] This repo is official implementation for the paper "Towards Harnessing Large Language Models as Autonomous Agents for Semantic…☆10May 25, 2024Updated 2 years ago
- Transformer + GAT for RNA chemical reactivity prediction| Stanford Ribonanza☆11Jan 28, 2026Updated 6 months ago
- ☆68Feb 6, 2026Updated 5 months ago
- Statistics and Visualization of acceptance rate, main keyword of CVPR 2023 accepted papers for the main Computer Vision conference (CVPR)☆13May 4, 2023Updated 3 years ago