Deployment & experimentation of LLM inference at production scale (P/D disaggregation, KV offloading, parallelism, and autoscaling).
☆62Sep 26, 2026Updated 3 weeks ago
Alternatives and similar repositories for deployment-guide
Users that are interested in deployment-guide are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Plug-and-play PyTorch transformer research framework. Swap attention, FFN, norm, positional, connection, projection, optimizer, scheduler…☆18Updated this week
- everything you need to know about inference engineering☆43Sep 29, 2026Updated 3 weeks ago
- mumwelt provides the environment for an agent to effectively commune with the Marin project☆26Sep 7, 2026Updated last month
- NCCL communication API layer, and transport layer created from first principles.☆16Aug 20, 2025Updated last year
- ☆76Sep 30, 2026Updated 2 weeks ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- A distributed training framework based on torchtitan☆107Aug 17, 2026Updated 2 months ago
- Hand Codex a PRD. Get a working feature back. One story per subagent, fresh context every time.☆25Jun 22, 2026Updated 3 months ago
- ☆149Updated this week
- ☆29Sep 7, 2026Updated last month
- Agent-assisted and full-agent reproducibility package for MLSys 2026 FlashInfer AI Kernel Generation Contest submissions: kernels, agent …☆24Jul 21, 2026Updated 3 months ago
- Explore training for quantized models☆29Jul 12, 2025Updated last year
- ☆191Sep 8, 2026Updated last month
- A collection of megakernels for TPU☆165Updated this week
- Educational distributed training and inference library for heterogeneous local hardware: Mac minis, Raspberry Pis and GPUs over plain Pyt…☆90Oct 7, 2026Updated last week
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- a tool like just and entr. A minimal cross-platform, config-driven tool for running commands whenever files change☆15Sep 2, 2026Updated last month
- Protein structure via next token prediction☆31Updated this week
- New results and AI-powered research on the square packing problem☆42Updated this week
- Piecewise-Taylor Attention☆47Aug 4, 2026Updated 2 months ago
- ☆56Updated this week
- The Fish Audio Infernence kernel opensource project.☆28Updated this week
- GPU kernel optimization framework☆32Sep 4, 2026Updated last month
- This is a CLI tool for playing music quickly made in python.☆10Jul 8, 2024Updated 2 years ago
- Sequential Monte Carlo Speculative Decoding☆54Aug 25, 2026Updated last month
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆13Aug 17, 2024Updated 2 years ago
- ☆17May 15, 2024Updated 2 years ago
- ☆38Sep 18, 2026Updated last month
- Open-source transpiler for CUDA Tile (13.1) migration☆19Dec 9, 2025Updated 10 months ago
- This repository implements DSPy programs to tasks in Indian Languages☆15Jan 16, 2024Updated 2 years ago
- how to deploy your model☆62Sep 15, 2026Updated last month
- ☆14Jan 22, 2026Updated 8 months ago
- Welcome to the Google Summer of Code (GSoC) 2024! This repository is your go-to resource for all the information you need to participate …☆17Feb 26, 2024Updated 2 years ago
- A simple library for generating instruction tuning datasets locally☆120Sep 20, 2026Updated last month
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- exBERT on Transformers🤗☆10Jun 14, 2021Updated 5 years ago
- A framework for building robust RL environments to train aligned AI.☆143Updated this week
- A notebook using numpy, scipy, and matplotlib to show the concepts taught in the course Linear Algebra by Prof. Gilbert Strang at MIT☆11Jul 16, 2022Updated 4 years ago
- A collection of GPU experiments and benchmarks for my personal understanding and research.☆43Aug 19, 2026Updated 2 months ago
- Fork of Triton repository for OpenXLA uses of the Triton language and compiler☆17Oct 6, 2026Updated 2 weeks ago
- a rubric driven prioritized replay rl algo to maximise continual learning☆16Oct 12, 2025Updated last year
- ☆120Oct 7, 2026Updated last week