Alternatives and similar repositories for megfile

Users that are interested in megfile are comparing it to the libraries listed below

• HFAiLab / ffrecord
  FireFlyer Record file format, writer and reader for DL training samples.
  ☆231Updated 2 years ago
• SandAI-org / MagiAttention
  A Distributed Attention Towards Linear Scalability for Ultra-Long Context, Heterogeneous Data Training
  ☆495Updated this week
• TencentARC / mllm-npu
  mllm-npu: training multimodal large language models on Ascend NPUs
  ☆91Updated last year
• ppwwyyxx / RAM-multiprocess-dataloader
  Demystify RAM Usage in Multi-Process Data Loaders
  ☆200Updated 2 years ago
• mit-han-lab / patch_conv
  Patch convolution to avoid large GPU memory usage of Conv2D
  ☆92Updated 7 months ago
• vipshop / cache-dit
  A Unified Cache Acceleration Toolbox for 🤗Diffusers: FLUX.1, Qwen-Image-Edit, Qwen-Image, Wan2.1/2.2, etc.
  ☆244Updated this week
• ByteDance-Seed / VeOmni
  VeOmni: Scaling any Modality Model Training to any Accelerators with PyTorch native Training Framework
  ☆1,012Updated last week
• megvii-research / hpman
  A hyperparameter manager for deep learning experiments.
  ☆96Updated 2 years ago
• Tele-AI / TeleTron
  To pioneer training long-context multi-modal transformer models
  ☆49Updated 3 weeks ago
• shawnricecake / draft-attention
  Code for Draft Attention
  ☆90Updated 3 months ago
• stepfun-ai / Step3
  ☆413Updated 3 weeks ago
• RiseAI-Sys / DAX
  High performance inference engine for diffusion models
  ☆81Updated last month
• silverbulletmdc / showdata
  Large scale image dataset visiualization tool.
  ☆119Updated 2 months ago
• FateScript / dotfiles
  useful dotfiles included vim, zsh, tmux and vscode
  ☆18Updated last month
• Oneflow-Inc / vision
  Datasets, Transforms and Models specific to Computer Vision
  ☆88Updated last year
• Ascend / pytorch
  Ascend PyTorch adapter (torch_npu). Mirror of https://gitee.com/ascend/pytorch
  ☆422Updated this week
• MegEngine / mgeconvert
  MegEngine到其他框架的转换器
  ☆70Updated 2 years ago
• xdit-project / DistVAE
  A parallelism VAE avoids OOM for high resolution image generation
  ☆76Updated last month
• ICT-ANS / StarLight
  ☆61Updated last year
• octoml / deformable-attention-kernel
  TVMScript kernel for deformable attention
  ☆25Updated 3 years ago
• DeepLink-org / CVFusion
  CVFusion is an open-source deep learning compiler to fuse the OpenCV operators.
  ☆31Updated 3 years ago
• DeepLink-org / dlinfer
  ☆54Updated last week
• open-mmlab / ecosystem
  ☆37Updated 2 years ago
• megvii-research / Sparsebit
  A model compression and acceleration toolbox based on pytorch.
  ☆332Updated last year
• NVlabs / COAT
  [ICLR 2025] COAT: Compressing Optimizer States and Activation for Memory-Efficient FP8 Training
  ☆236Updated 3 weeks ago
• thu-nics / DiTFastAttn
  ☆173Updated 7 months ago
• AdaCache-DiT / AdaCache
  Adaptive Caching for Faster Video Generation with Diffusion Transformers
  ☆156Updated 10 months ago
• intelligent-machine-learning / atorch
  An industrial extension library of pytorch to accelerate large scale model training
  ☆47Updated 3 weeks ago
• nvidia-cosmos / cosmos-rl
  Cosmos-RL is a flexible and scalable Reinforcement Learning framework specialized for Physical AI applications.
  ☆138Updated this week
• svg-project / Sparse-VideoGen
  [ICML2025] Sparse VideoGen: Accelerating Video Diffusion Transformers with Spatial-Temporal Sparsity
  ☆420Updated last week