Alternatives and similar repositories for megfile:

Users that are interested in megfile are comparing it to the libraries listed below

• HFAiLab / ffrecord
  FireFlyer Record file format, writer and reader for DL training samples.
  ☆121Updated 2 years ago
• megvii-research / hpman
  A hyperparameter manager for deep learning experiments.
  ☆96Updated 2 years ago
• Ascend / pytorch
  Ascend PyTorch adapter (torch_npu). Mirror of https://gitee.com/ascend/pytorch
  ☆291Updated this week
• Oneflow-Inc / libai
  LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training
  ☆397Updated 2 months ago
• FateScript / dotfiles
  useful dotfiles included vim, zsh, tmux and vscode
  ☆18Updated 3 weeks ago
• Oneflow-Inc / vision
  Datasets, Transforms and Models specific to Computer Vision
  ☆84Updated last year
• MegEngine / mgeconvert
  MegEngine到其他框架的转换器
  ☆69Updated last year
• octoml / deformable-attention-kernel
  TVMScript kernel for deformable attention
  ☆24Updated 3 years ago
• Ascend / AscendSpeed
  ☆76Updated last year
• silverbulletmdc / showdata
  Large scale image dataset visiualization tool.
  ☆119Updated last year
• TencentARC / mllm-npu
  mllm-npu: training multimodal large language models on Ascend NPUs
  ☆90Updated 4 months ago
• ppwwyyxx / RAM-multiprocess-dataloader
  Demystify RAM Usage in Multi-Process Data Loaders
  ☆187Updated last year
• InternLM / InternEvo
  InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencie…
  ☆331Updated this week
• YellowOldOdd / SDBI
  Simple Dynamic Batching Inference
  ☆145Updated 2 years ago
• torchpipe / torchpipe
  Serving Inside Pytorch
  ☆150Updated 3 weeks ago
• itsliupeng / torchnvjpeg
  Decode JPEG image on GPU using PyTorch
  ☆84Updated last year
• FlagOpen / FlagAttention
  A collection of memory efficient attention operators implemented in the Triton language.
  ☆230Updated 7 months ago
• sail-sg / zero-bubble-pipeline-parallelism
  Zero Bubble Pipeline Parallelism
  ☆309Updated 2 months ago
• ModelTC / NART
  NART = NART is not A RunTime, a deep learning inference framework.
  ☆38Updated last year
• FlagOpen / FlagScale
  FlagScale is a large model toolkit based on open-sourced projects.
  ☆208Updated this week
• OpenGVLab / gv-benchmark
  General Vision Benchmark, GV-B, a project from OpenGVLab
  ☆189Updated 2 years ago
• DeepLink-org / dlinfer
  ☆33Updated this week
• bytedance / ByteTransformer
  optimized BERT transformer inference on NVIDIA GPU. https://arxiv.org/abs/2210.03052
  ☆467Updated 10 months ago
• feifeibear / long-context-attention
  USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference
  ☆403Updated 3 weeks ago
• DeepLink-org / CVFusion
  CVFusion is an open-source deep learning compiler to fuse the OpenCV operators.
  ☆28Updated 2 years ago
• xdit-project / DistVAE
  A parallelism VAE avoids OOM for high resolution image generation
  ☆50Updated last week
• alibaba / EasyParallelLibrary
  Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.
  ☆266Updated last year
• OpenGVLab / MM-Interleaved
  MM-Interleaved: Interleaved Image-Text Generative Modeling via Multi-modal Feature Synchronizer
  ☆210Updated 9 months ago
• zw0610 / zw0610.github.io
  ☆57Updated 4 years ago
• bytedance / lynx-llm
  paper: https://arxiv.org/abs/2307.02469 page: https://lynx-llm.github.io/
  ☆237Updated last year