megvii-research / megfile
Megvii FILE Library - Working with Files in Python same as the standard library
☆136Updated last week
Alternatives and similar repositories for megfile:
Users that are interested in megfile are comparing it to the libraries listed below
- A hyperparameter manager for deep learning experiments.☆96Updated 2 years ago
- FireFlyer Record file format, writer and reader for DL training samples.☆205Updated 2 years ago
- LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training☆401Updated 3 weeks ago
- ByteCheckpoint: An Unified Checkpointing Library for LFMs☆182Updated last week
- VeOmni: Scaling any Modality Model Training to any Accelerators with PyTorch native Training Framework☆262Updated this week
- A high-performance, extensible Python AOT compiler.☆421Updated last year
- USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference☆465Updated this week
- Zero Bubble Pipeline Parallelism☆380Updated last month
- Simple Dynamic Batching Inference☆145Updated 3 years ago
- Datasets, Transforms and Models specific to Computer Vision☆85Updated last year
- TVMScript kernel for deformable attention☆25Updated 3 years ago
- ☆17Updated 3 weeks ago
- MegEngine到其他框架的转换器☆69Updated last year
- Demystify RAM Usage in Multi-Process Data Loaders☆191Updated last year
- optimized BERT transformer inference on NVIDIA GPU. https://arxiv.org/abs/2210.03052☆471Updated last year
- Distributed Triton for Parallel Systems☆146Updated this week
- useful dotfiles included vim, zsh, tmux and vscode☆18Updated 3 months ago
- CVFusion is an open-source deep learning compiler to fuse the OpenCV operators.☆29Updated 2 years ago
- mllm-npu: training multimodal large language models on Ascend NPUs☆91Updated 7 months ago
- Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.☆267Updated 2 years ago
- General Vision Benchmark, GV-B, a project from OpenGVLab☆189Updated 3 years ago
- NART = NART is not A RunTime, a deep learning inference framework.☆38Updated 2 years ago
- A communication library for deep learning☆50Updated 8 months ago
- ☆47Updated last week
- ☆78Updated last year
- OneFlow models for benchmarking.☆104Updated 8 months ago
- A parallelism VAE avoids OOM for high resolution image generation☆57Updated 2 months ago
- Microsoft Automatic Mixed Precision Library☆590Updated 6 months ago
- Large scale image dataset visiualization tool.☆119Updated last year
- [ICLR 2025] COAT: Compressing Optimizer States and Activation for Memory-Efficient FP8 Training☆175Updated last week