deepseek-ai / 3FSLinks
A high-performance distributed file system designed to address the challenges of AI training and inference workloads.
☆9,555Updated last week
Alternatives and similar repositories for 3FS
Users that are interested in 3FS are comparing it to the libraries listed below
Sorting:
- A lightweight data processing framework built on DuckDB and 3FS.☆4,877Updated 9 months ago
- DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling☆6,013Updated last week
- DeepEP: an efficient expert-parallel communication library☆8,839Updated last week
- A bidirectional pipeline parallelism algorithm for computation-communication overlap in DeepSeek V3/R1 training.☆2,894Updated 9 months ago
- Production-tested AI infrastructure tools for efficient AGI development and community-driven innovation☆7,952Updated 7 months ago
- FlashMLA: Efficient Multi-head Latent Attention Kernels☆11,943Updated 2 weeks ago
- Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.☆4,515Updated this week
- Expert Parallelism Load Balancer☆1,324Updated 9 months ago
- A Datacenter Scale Distributed Inference Serving Framework☆5,698Updated this week
- Analyze computation-communication overlap in V3/R1.☆1,129Updated 9 months ago
- FlashInfer: Kernel Library for LLM Serving☆4,400Updated this week
- SGLang is a high-performance serving framework for large language models and multimodal models.☆22,092Updated this week
- Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels☆4,336Updated this week
- Supercharge Your LLM with the Fastest KV Cache Layer☆6,567Updated this week
- Cost-efficient and pluggable Infrastructure components for GenAI inference☆4,489Updated last week
- A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.☆2,709Updated this week
- A course of learning LLM inference serving on Apple Silicon for systems engineers: build a tiny vLLM + Qwen.☆3,610Updated 2 weeks ago
- vLLM’s reference system for K8S-native cluster-wide deployment with community-driven performance optimization☆2,057Updated 2 weeks ago
- Democratizing Reinforcement Learning for LLMs☆4,917Updated this week
- Developer-friendly OSS embedded retrieval library for multimodal AI. Search More; Manage Less.☆8,383Updated this week
- A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations☆16,296Updated this week
- Mirage Persistent Kernel: Compiling LLMs into a MegaKernel☆2,015Updated 2 weeks ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆66,734Updated this week
- verl: Volcano Engine Reinforcement Learning for LLMs☆17,954Updated this week
- Nano vLLM☆10,412Updated 2 months ago
- Renderer for the harmony response format to be used with gpt-oss☆4,111Updated 2 weeks ago
- Minimalistic 4D-parallelism distributed training framework for education purpose☆1,935Updated 4 months ago
- The official repo of MiniMax-Text-01 and MiniMax-VL-01, large-language-model & vision-language-model based on Linear Attention☆3,283Updated 5 months ago
- LMDeploy is a toolkit for compressing, deploying, and serving LLMs.☆7,466Updated this week
- ☆91,615Updated 6 months ago