Alternatives and similar repositories for megfile

Users that are interested in megfile are comparing it to the libraries listed below

• HFAiLab / ffrecord
  FireFlyer Record file format, writer and reader for DL training samples.
  ☆227Updated 2 years ago
• megvii-research / hpman
  A hyperparameter manager for deep learning experiments.
  ☆96Updated 2 years ago
• vipshop / cache-dit
  🤗CacheDiT: A Training-free and Easy-to-use Cache Acceleration Toolbox for Diffusion Transformers.
  ☆104Updated this week
• silverbulletmdc / showdata
  Large scale image dataset visiualization tool.
  ☆119Updated 2 weeks ago
• ppwwyyxx / RAM-multiprocess-dataloader
  Demystify RAM Usage in Multi-Process Data Loaders
  ☆194Updated 2 years ago
• FateScript / dotfiles
  useful dotfiles included vim, zsh, tmux and vscode
  ☆18Updated 2 weeks ago
• ByteDance-Seed / VeOmni
  VeOmni: Scaling any Modality Model Training to any Accelerators with PyTorch native Training Framework
  ☆374Updated this week
• Tele-AI / TeleTron
  To pioneer training long-context multi-modal transformer models
  ☆42Updated last month
• TencentARC / mllm-npu
  mllm-npu: training multimodal large language models on Ascend NPUs
  ☆91Updated 10 months ago
• SandAI-org / MagiAttention
  A Distributed Attention Towards Linear Scalability for Ultra-Long Context, Heterogeneous Data Training
  ☆424Updated this week
• Oneflow-Inc / vision
  Datasets, Transforms and Models specific to Computer Vision
  ☆87Updated last year
• Ascend / pytorch
  Ascend PyTorch adapter (torch_npu). Mirror of https://gitee.com/ascend/pytorch
  ☆388Updated this week
• MegEngine / mgeconvert
  MegEngine到其他框架的转换器
  ☆70Updated 2 years ago
• octoml / deformable-attention-kernel
  TVMScript kernel for deformable attention
  ☆25Updated 3 years ago
• Oneflow-Inc / libai
  LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training
  ☆408Updated 3 weeks ago
• torchpipe / torchpipe
  Serving Inside Pytorch
  ☆163Updated this week
• xxcheng0708 / pytorch-model-train-template
  pytorch单精度、半精度、混合精度、单卡、多卡（DP / DDP）、FSDP、DeepSpeed模型训练代码，并对比不同方法的训练速度以及GPU内存的使用
  ☆112Updated last year
• DeepVAC / TorchPod
  跨平台的容器化Linux桌面环境
  ☆70Updated 4 months ago
• ICT-ANS / StarLight
  ☆61Updated last year
• opendatalab / laion5b-downloader
  ☆112Updated 2 years ago
• mit-han-lab / patch_conv
  Patch convolution to avoid large GPU memory usage of Conv2D
  ☆90Updated 5 months ago
• open-mmlab / ecosystem
  ☆37Updated last year
• DeepLink-org / CVFusion
  CVFusion is an open-source deep learning compiler to fuse the OpenCV operators.
  ☆30Updated 2 years ago
• NVlabs / COAT
  [ICLR 2025] COAT: Compressing Optimizer States and Activation for Memory-Efficient FP8 Training
  ☆215Updated last month
• thu-nics / DiTFastAttn
  ☆171Updated 6 months ago
• YellowOldOdd / SDBI
  Simple Dynamic Batching Inference
  ☆145Updated 3 years ago
• megvii-research / Sparsebit
  A model compression and acceleration toolbox based on pytorch.
  ☆331Updated last year
• megvii-research / hpargparse
  argparse extension for hpman
  ☆17Updated 2 years ago
• itsliupeng / torchnvjpeg
  Decode JPEG image on GPU using PyTorch
  ☆91Updated last year
• DeepLink-org / dlinfer
  ☆53Updated 2 weeks ago