Accelerating Long Context LLM Inference with Accuracy-Preserving Context Optimization in SGLang, vLLM, llama.cpp, RAG, and Agentic AI.
☆65Mar 19, 2026Updated this week
Alternatives and similar repositories for ContextPilot
Users that are interested in ContextPilot are comparing it to the libraries listed below
Sorting:
- An intelligent tuner for vLLM that automatically monitors GPU metrics, uses Bayesian optimization to tune parameters☆59Mar 12, 2026Updated last week
- A framework for evaluating the effectiveness of chain-of-thought reasoning in language models.☆19Feb 6, 2025Updated last year
- This Repo collects and organizes the resources you will need to follow a learning path towards Phsyical AI. From starting out with electr…☆47Feb 9, 2026Updated last month
- Here is the repo for public scripts.☆11Jul 16, 2022Updated 3 years ago
- libsmctrl论文的复现，添加了python端接口，可以在python端灵活调用接口来分配计算资源☆12May 21, 2024Updated last year
- Pie: Programmable LLM Serving☆131Updated this week
- Accelerated in CUDA☆11Oct 28, 2022Updated 3 years ago
- Slowdown prediction module of Echo: Simulating Distributed Training at Scale☆13May 17, 2025Updated 10 months ago
- Automatic Differentiation for high-performance stencil loops☆13Mar 25, 2021Updated 4 years ago
- Code for "Practical Low-Rank Communication Compression in Decentralized Deep Learning"☆17Aug 4, 2020Updated 5 years ago
- [EuroSys'25] Mist: Efficient Distributed Training of Large Language Models via Memory-Parallelism Co-Optimization☆22Feb 5, 2026Updated last month
- Optimize multiple knapsack problem using reinforcement learning.☆14Jun 3, 2024Updated last year
- Reinforcement Learning Framework for Visual Generation☆87Feb 13, 2026Updated last month
- the official code of DriveMonkey☆45Updated this week
- ☆19Dec 31, 2025Updated 2 months ago
- Cross-platform mobile app for Perplexica Project☆22Feb 18, 2026Updated last month
- Agentkube - Run Kubernetes Like Never Before☆37Mar 1, 2026Updated 3 weeks ago
- A comprehensive paper list of Table-based Question Answering.☆37Sep 1, 2023Updated 2 years ago
- An easy way to run, test, benchmark and tune OpenCL kernel files☆24Aug 25, 2023Updated 2 years ago
- Run AI coding agents safely in Docker containers. Your code stays isolated - no surprises on your host machine.☆43Feb 11, 2026Updated last month
- A distributed GPU-centric experience replay system for large AI models.☆19Aug 1, 2023Updated 2 years ago
- Sparse kernels for GNNs based on TVM☆17Nov 18, 2020Updated 5 years ago
- [CVPR 2025] A Unified Image-Dense Annotation Generation Model for Underwater Scenes☆55Apr 9, 2025Updated 11 months ago
- Lightly-reviewed collection of community environments☆219Mar 12, 2026Updated last week
- ☆20Jul 22, 2022Updated 3 years ago
- [NSDI25] AutoCCL: Automated Collective Communication Tuning for Accelerating Distributed and Parallel DNN Training☆31May 2, 2025Updated 10 months ago
- Serverless LLM Serving for Everyone.☆664Mar 6, 2026Updated 2 weeks ago
- Reproduction paper --- PDFTriage : Question Answering over Long, Structured Documents☆43Jan 16, 2024Updated 2 years ago
- Marketplace ML experiment - training without backprop☆27Sep 9, 2025Updated 6 months ago
- PAHF Personalized Agent from Human Feedback☆44Mar 6, 2026Updated 2 weeks ago
- Official repository for ICLR 2024 Spotlight paper "Large Language Models Are Not Robust Multiple Choice Selectors"☆43May 20, 2025Updated 10 months ago
- Leveraging Outputs of Large Language Model as Feedback for Dynamic Reranking in Retrieval-Augmented Generation☆64Sep 28, 2025Updated 5 months ago
- ☆32Apr 2, 2025Updated 11 months ago
- Use NavamAI to supercharge your productivity and workflow with personal, fast, and quality AI. Turn your Terminal into a configurable, in…☆26Oct 15, 2024Updated last year
- [DAC'25] Official implement of "HybriMoE: Hybrid CPU-GPU Scheduling and Cache Management for Efficient MoE Inference"☆105Dec 15, 2025Updated 3 months ago
- [NeurIPS'25 Spotlight] Adaptive Attention Sparsity with Hierarchical Top-p Pruning☆89Nov 29, 2025Updated 3 months ago
- ☆24May 1, 2022Updated 3 years ago
- ☆70Jan 18, 2026Updated 2 months ago
- [ECCV 2024] Make Your ViT-based Multi-view 3D Detectors Faster via Token Compression☆51Sep 21, 2024Updated last year