megvii-research / megfileLinks
Megvii FILE Library - Working with Files in Python same as the standard library
☆154Updated 2 weeks ago
Alternatives and similar repositories for megfile
Users that are interested in megfile are comparing it to the libraries listed below
Sorting:
- To pioneer training long-context multi-modal transformer models☆58Updated last month
- FireFlyer Record file format, writer and reader for DL training samples.☆234Updated 2 years ago
- mllm-npu: training multimodal large language models on Ascend NPUs☆92Updated last year
- A Distributed Attention Towards Linear Scalability for Ultra-Long Context, Heterogeneous Data Training☆523Updated this week
- A Unified Cache Acceleration Framework for 🤗 Diffusers: Qwen-Image-Lightning, Qwen-Image, HunyuanImage, FLUX, Wan, etc.☆371Updated this week
- useful dotfiles included vim, zsh, tmux and vscode☆18Updated 3 weeks ago
- Patch convolution to avoid large GPU memory usage of Conv2D☆92Updated 8 months ago
- VeOmni: Scaling Any Modality Model Training with Model-Centric Distributed Recipe Zoo☆1,178Updated this week
- Demystify RAM Usage in Multi-Process Data Loaders☆201Updated 2 years ago
- A hyperparameter manager for deep learning experiments.☆95Updated 2 years ago
- ☆427Updated last month
- Large scale image dataset visiualization tool.☆119Updated 3 months ago
- Megatron's multi-modal data loader☆250Updated last week
- Code for Draft Attention☆90Updated 4 months ago
- High performance inference engine for diffusion models☆92Updated 3 weeks ago
- Datasets, Transforms and Models specific to Computer Vision☆89Updated last year
- ☆113Updated 2 years ago
- TVMScript kernel for deformable attention☆25Updated 3 years ago
- A parallelism VAE avoids OOM for high resolution image generation☆80Updated last month
- CVFusion is an open-source deep learning compiler to fuse the OpenCV operators.☆31Updated 3 years ago
- ☆178Updated 8 months ago
- Ascend PyTorch adapter (torch_npu). Mirror of https://gitee.com/ascend/pytorch☆434Updated 2 weeks ago
- Tiny-FSDP, a minimalistic re-implementation of the PyTorch FSDP☆82Updated last month
- ByteCheckpoint: An Unified Checkpointing Library for LFMs☆248Updated 2 months ago
- pytorch-profiler☆51Updated 2 years ago
- ☆61Updated last year
- An industrial extension library of pytorch to accelerate large scale model training☆50Updated last month
- Lightning Attention-2: A Free Lunch for Handling Unlimited Sequence Lengths in Large Language Models☆328Updated 7 months ago
- Simple Dynamic Batching Inference☆146Updated 3 years ago
- MegEngine到其他框架的转换器☆70Updated 2 years ago