Accelerating AI Training and Inference from Storage Perspective (Must-read Papers on Storage for AI)
☆64Jun 22, 2026Updated last month
Alternatives and similar repositories for Storage-for-AI-Paper
Users that are interested in Storage-for-AI-Paper are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆15Jan 21, 2023Updated 3 years ago
- Must-read Papers for File System (FS)☆326Dec 17, 2025Updated 7 months ago
- GeminiFS: A Companion File System for GPUs☆85Jul 8, 2026Updated 3 weeks ago
- InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management (OSDI'24)☆190Jul 10, 2024Updated 2 years ago
- ☆15Apr 11, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆25Mar 31, 2022Updated 4 years ago
- ☆18May 16, 2022Updated 4 years ago
- NVMe based File System in User-space☆112Feb 16, 2020Updated 6 years ago
- ☆23Jun 21, 2023Updated 3 years ago
- MLPerf® Storage Benchmark Suite☆193Updated this week
- LLM checkpointing for DeepSpeed/Megatron☆26Nov 30, 2025Updated 7 months ago
- ☆16Apr 13, 2024Updated 2 years ago
- ☆23Feb 16, 2023Updated 3 years ago
- Official implementation of ICML 2024 paper "ExCP: Extreme LLM Checkpoint Compression via Weight-Momentum Joint Shrinking".☆48Jul 12, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆25May 29, 2026Updated 2 months ago
- CrossFS: A Cross-layered Direct-Access File System☆27Sep 5, 2022Updated 3 years ago
- A mirror of https://bitbucket.org/ajaustin/hemem/src/sosp-submission/☆28May 3, 2023Updated 3 years ago
- This repository is deprecated. See below for details.☆31Jul 27, 2018Updated 8 years ago
- ☆39Jan 15, 2021Updated 5 years ago
- Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.☆48Jun 11, 2025Updated last year
- ☆36Mar 28, 2023Updated 3 years ago
- [NeurIPS 2024] Implementation of paper - D-LLM: A Token Adaptive Computing Resource Allocation Strategy for Large Language Models☆24Apr 9, 2025Updated last year
- An I/O benchmark for deep Learning applications☆108Jun 18, 2026Updated last month
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- NEO is a LLM inference engine built to save the GPU memory crisis by CPU offloading☆100Jun 16, 2025Updated last year
- Dynamic Memory Management for Serving LLMs without PagedAttention☆506Jul 17, 2026Updated last week
- A tracing tool to analyze the I/O behavior of a program.☆12Sep 25, 2019Updated 6 years ago
- Write a simple file system from zero.☆12Apr 14, 2024Updated 2 years ago
- A Fast Graph Update Library for FPGA-based Dynamic Graph Processing☆10Dec 20, 2021Updated 4 years ago
- ☆10Feb 22, 2023Updated 3 years ago
- Gengar, a distributed shared hybrid memory pool with RDMA support. Gengar allows applications to access remote DRAM/NVM in a large and gl…☆24May 24, 2022Updated 4 years ago
- Source code for the FAST '23 paper “MadFS: Per-File Virtualization for Userspace Persistent Memory Filesystems”☆51Mar 5, 2023Updated 3 years ago
- Profiling and Improving the PyTorch Dataloader for high-latency Storage☆21Apr 18, 2023Updated 3 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Everything you always wanted to know about ANNS but were afraid to ask 🥰☆12Dec 21, 2024Updated last year
- It's an experiment based on 09 KDD paper, Beyond Blacklists: Learning to Detect Malicious Web Sites from Suspicious URLs☆10Jan 8, 2019Updated 7 years ago
- ☆119May 3, 2021Updated 5 years ago
- Context File System for Agentic AI☆39Jul 14, 2026Updated 2 weeks ago
- RFUSE: Modernizing Userspace Filesystem Framework through Scalable Kernel-Userspace Communication☆75May 8, 2025Updated last year
- A Filesystem Semi-Microkernel.☆48Oct 24, 2023Updated 2 years ago
- ☆26Dec 12, 2017Updated 8 years ago