Accelerating AI Training and Inference from Storage Perspective (Must-read Papers on Storage for AI)
☆67Nov 3, 2026Updated this week
Alternatives and similar repositories for Storage-for-AI-Paper
Users that are interested in Storage-for-AI-Paper are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆15Jan 21, 2023Updated 3 years ago
- Must-read Papers for File System (FS)☆330Dec 17, 2025Updated 10 months ago
- LLM checkpointing for DeepSpeed/Megatron☆27Nov 30, 2025Updated 11 months ago
- GeminiFS: A Companion File System for GPUs☆85Aug 11, 2026Updated 2 months ago
- InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management (OSDI'24)☆195Jul 10, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Dataset and Analysis for the FAST25 paper: "Cloudscape: A Study of Storage Services in Modern Cloud Architectures"☆18Feb 20, 2025Updated last year
- Artifact Evaluation for OSDI'26 paper CoPilotIO: CPU as a Co-pilot for GPU I/O to Free GPU Compute☆27May 9, 2026Updated 5 months ago
- ☆10Sep 12, 2024Updated 2 years ago
- ☆15Apr 11, 2024Updated 2 years ago
- ☆25Mar 31, 2022Updated 4 years ago
- ☆18May 16, 2022Updated 4 years ago
- ☆13Aug 28, 2026Updated 2 months ago
- NVMe based File System in User-space☆113Feb 16, 2020Updated 6 years ago
- ☆23Jun 21, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- MLPerf® Storage Benchmark Suite☆208Sep 23, 2026Updated last month
- DL Dataloader Benchmarks☆20Jan 27, 2025Updated last year
- ☆23Feb 16, 2023Updated 3 years ago
- Phoenix is a direct hub between storage and xPU — plug in any accelerator (GPU/NPU) or AI app and stream data straight to the chip.☆30Updated this week
- ☆45Jun 13, 2025Updated last year
- Official implementation of ICML 2024 paper "ExCP: Extreme LLM Checkpoint Compression via Weight-Momentum Joint Shrinking".☆48Jul 12, 2024Updated 2 years ago
- Accommodating Large Language Model Training over Heterogeneous Environment.☆36Mar 13, 2025Updated last year
- CrossFS: A Cross-layered Direct-Access File System☆27Sep 5, 2022Updated 4 years ago
- ☆22Apr 7, 2014Updated 12 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- SHADE: Enable Fundamental Cacheability for Distributed Deep Learning Training☆36Mar 1, 2023Updated 3 years ago
- A native macOS & iOS academic literature manager purpose-built for Computer Science researchers. Streamlines organizing papers, taking in…☆15Oct 25, 2026Updated last week
- ☆38Jan 15, 2021Updated 5 years ago
- ☆36Mar 28, 2023Updated 3 years ago
- NEO is a LLM inference engine built to save the GPU memory crisis by CPU offloading☆99Jun 16, 2025Updated last year
- An issues only repo to organize our TODO items☆23Aug 25, 2020Updated 6 years ago
- [NeurIPS 2024] Implementation of paper - D-LLM: A Token Adaptive Computing Resource Allocation Strategy for Large Language Models☆26Apr 9, 2025Updated last year
- Dynamic Memory Management for Serving LLMs without PagedAttention☆526Aug 24, 2026Updated 2 months ago
- A tracing tool to analyze the I/O behavior of a program.☆12Sep 25, 2019Updated 7 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆250Mar 28, 2026Updated 7 months ago
- Playground for code optimization using strands agents☆11Jan 3, 2026Updated 10 months ago
- Gengar, a distributed shared hybrid memory pool with RDMA support. Gengar allows applications to access remote DRAM/NVM in a large and gl…☆24May 24, 2022Updated 4 years ago
- ☆27Oct 30, 2026Updated last week
- Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.☆48Jun 11, 2025Updated last year
- Write a simple file system from zero.☆12Apr 14, 2024Updated 2 years ago
- This is the public repo for DREAM accepted to ICS 2025.☆12Dec 28, 2025Updated 10 months ago