fuzihaofzh / cstl
The C++ Standard Template Library (STL) for Python.
☆23Updated last year
Alternatives and similar repositories for cstl
Users that are interested in cstl are comparing it to the libraries listed below
Sorting:
- Demystify RAM Usage in Multi-Process Data Loaders☆193Updated 2 years ago
- ☆106Updated 11 months ago
- Implementation of fused cosine similarity attention in the same style as Flash Attention☆213Updated 2 years ago
- Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.☆157Updated last year
- Implementation of a Transformer, but completely in Triton☆265Updated 3 years ago
- Memory-Efficient CUDA kernels for training ConvNets with PyTorch.☆40Updated 2 months ago
- Python pdb for multiple processes☆40Updated 2 years ago
- Torch Distributed Experimental☆115Updated 9 months ago
- M4 experiment logbook☆57Updated last year
- ☆180Updated 7 months ago
- Official repository for "Revisiting Weakly Supervised Pre-Training of Visual Perception Models". https://arxiv.org/abs/2201.08371.☆179Updated 3 years ago
- ☆103Updated last year
- Code release for "Dropout Reduces Underfitting"☆313Updated 2 years ago
- See details in https://github.com/pytorch/xla/blob/r1.12/torch_xla/distributed/fsdp/README.md☆24Updated 2 years ago
- PyTorch code for hierarchical k-means -- a data curation method for self-supervised learning☆152Updated 10 months ago
- Helpful tools and examples for working with flex-attention☆766Updated last week
- Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).☆225Updated 3 years ago
- Examples for the WebDataset PyTorch Dataset Library☆49Updated 3 years ago
- ☆64Updated last year
- Megatron's multi-modal data loader☆197Updated last week
- ☆23Updated 11 months ago
- Repository of the paper "Accelerating Transformer Inference for Translation via Parallel Decoding"☆116Updated last year
- [ICLR 2022] "As-ViT: Auto-scaling Vision Transformers without Training" by Wuyang Chen, Wei Huang, Xianzhi Du, Xiaodan Song, Zhangyang Wa…☆76Updated 3 years ago
- Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not Need O(n²) Memory"☆378Updated last year
- A code generator from ONNX to PyTorch code☆136Updated 2 years ago
- This repository contains the experimental PyTorch native float8 training UX☆224Updated 9 months ago
- Run Effective Large Batch Contrastive Learning Beyond GPU/TPU Memory Constraint☆387Updated last year
- ☆158Updated last year
- A library that contains a rich collection of performant PyTorch model metrics, a simple interface to create new metrics, a toolkit to fac…☆228Updated 3 months ago
- A library for unit scaling in PyTorch☆125Updated 5 months ago