ezyang / torchdbg
PyTorch centric eager mode debugger
☆43Updated 4 months ago
Related projects ⓘ
Alternatives and complementary repositories for torchdbg
- Experiment of using Tangent to autodiff triton☆71Updated 9 months ago
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆35Updated 3 months ago
- TorchFix - a linter for PyTorch-using code with autofix support☆98Updated last month
- TORCH_LOGS parser for PT2☆21Updated 3 weeks ago
- An implementation of the Llama architecture, to instruct and delight☆21Updated 2 months ago
- A library for unit scaling in PyTorch☆105Updated this week
- Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.☆29Updated last week
- Make triton easier☆41Updated 4 months ago
- ☆17Updated 2 weeks ago
- ☆76Updated 5 months ago
- extensible collectives library in triton☆61Updated last month
- Hacks for PyTorch☆17Updated last year
- CUDA implementation of autoregressive linear attention, with all the latest research findings☆43Updated last year
- A user-friendly tool chain that enables the seamless execution of ONNX models using JAX as the backend.☆98Updated last month
- CUDA and Triton implementations of Flash Attention with SoftmaxN.☆66Updated 5 months ago
- ☆72Updated 4 months ago
- FlexAttention w/ FlashAttention3 Support☆26Updated last month
- A place to store reusable transformer components of my own creation or found on the interwebs☆43Updated this week
- A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…☆146Updated this week
- ☆140Updated this week
- A simple library for scaling up JAX programs☆125Updated last week
- ☆46Updated last month
- Multidimensional indexing for tensors☆112Updated last year
- A safetensors extension to efficiently store sparse quantized tensors on disk☆46Updated this week
- ML/DL Math and Method notes☆57Updated 11 months ago
- Automatically take good care of your preemptible TPUs☆31Updated last year
- Scalable and Performant Data Loading☆42Updated this week
- Scalable neural net training via automatic normalization in the modular norm.☆118Updated 2 months ago
- Fast, Modern, Memory Efficient, and Low Precision PyTorch Optimizers☆58Updated 3 months ago
- Personal solutions to the Triton Puzzles☆15Updated 3 months ago