A GPU-driven system framework for scalable AI applications
☆124Feb 5, 2025Updated last year
Alternatives and similar repositories for ark
Users that are interested in ark are comparing it to the libraries listed below
Sorting:
- A suite of tools to validate graphics output via HDMI or DisplayPort☆21Mar 14, 2024Updated last year
- MSCCL++: A GPU-driven communication stack for scalable AI applications☆469Feb 21, 2026Updated last week
- An experimental parallel training platform☆56Mar 25, 2024Updated last year
- The Artifact of NeoMem: Hardware/Software Co-Design for CXL-Native Memory Tiering☆63Aug 11, 2024Updated last year
- Experiments for "Automatic Calibration and Error Correction for Large Language Models via Pareto Optimal Self-Supervision"☆14Aug 4, 2023Updated 2 years ago
- A CCF-based, attested DNS server☆15Oct 6, 2025Updated 4 months ago
- MAGIS: Memory Optimization via Coordinated Graph Transformation and Scheduling for DNN (ASPLOS'24)☆56May 29, 2024Updated last year
- Python based LLM experimentation tool without code integration of your function(s) for the chain☆26Oct 19, 2023Updated 2 years ago
- Automatically generate github documentation with readthedocs using your openai endpoint☆40Jul 28, 2023Updated 2 years ago
- A curated list of awesome projects and papers for distributed training or inference☆266Oct 8, 2024Updated last year
- GLake: optimizing GPU memory management and IO transmission.☆498Mar 24, 2025Updated 11 months ago
- Compiler for Dynamic Neural Networks☆45Nov 13, 2023Updated 2 years ago
- Distributed Compiler based on Triton for Parallel Systems☆1,361Feb 13, 2026Updated 2 weeks ago
- PyTorch library for cost-effective, fast and easy serving of MoE models.☆284Updated this week
- A fast communication-overlapping library for tensor/expert parallelism on GPUs.☆1,261Aug 28, 2025Updated 6 months ago
- NCCL Profiling Kit☆152Jul 1, 2024Updated last year
- Programming system for NIC-accelerated network applications☆29Oct 5, 2018Updated 7 years ago
- ☆21Oct 31, 2024Updated last year
- Medusa: Accelerating Serverless LLM Inference with Materialization [ASPLOS'25]☆41May 13, 2025Updated 9 months ago
- Graph Transformers for Large Graphs☆22Apr 26, 2024Updated last year
- Efficient GPU communication over multiple NICs.☆24Nov 20, 2025Updated 3 months ago
- ☆78May 4, 2021Updated 4 years ago
- ☆20Sep 28, 2024Updated last year
- Artifact of ASPLOS'23 paper entitled: GRACE: A Scalable Graph-Based Approach to Accelerating Recommendation Model Inference☆19Mar 5, 2023Updated 2 years ago
- Tilus is a tile-level kernel programming language with explicit control over shared memory and registers.☆445Feb 4, 2026Updated 3 weeks ago
- A hierarchical collective communications library with portable optimizations☆37Dec 8, 2024Updated last year
- paper and its code for AI System☆348Feb 10, 2026Updated 2 weeks ago
- [ACM EuroSys 2023] Fast and Efficient Model Serving Using Multi-GPUs with Direct-Host-Access☆56Aug 6, 2025Updated 6 months ago
- ☆84Dec 2, 2022Updated 3 years ago
- PIM-DL: Expanding the Applicability of Commodity DRAM-PIMs for Deep Learning via Algorithm-System Co-Optimization☆36Feb 21, 2024Updated 2 years ago
- [ICDCS 2023] Evaluation and Optimization of Gradient Compression for Distributed Deep Learning☆10Apr 28, 2023Updated 2 years ago
- ☆11Jun 13, 2023Updated 2 years ago
- FTPipe and related pipeline model parallelism research.☆44May 16, 2023Updated 2 years ago
- Dynamic Memory Management for Serving LLMs without PagedAttention☆463May 30, 2025Updated 8 months ago
- Benchmark Suite for RDMA Performance Isolation☆41Sep 5, 2023Updated 2 years ago
- ArkVale: Efficient Generative LLM Inference with Recallable Key-Value Eviction (NIPS'24)☆53Dec 17, 2024Updated last year
- Supplemental materials for The ASPLOS 2025 / EuroSys 2025 Contest on Intra-Operator Parallelism for Distributed Deep Learning☆25May 12, 2025Updated 9 months ago
- Since the emergence of chatGPT in 2022, the acceleration of Large Language Model has become increasingly important. Here is a list of pap…☆282Mar 6, 2025Updated 11 months ago
- MLOps Model Factory is an end to end workflow that supports generating multiple models and used for deployment to any target.☆10May 9, 2024Updated last year