mosaicml / yahp
hyperparameter management
☆43Updated last year
Related projects: ⓘ
- ☆40Updated this week
- A lightweight wrapper for PyTorch that provides a simple declarative API for context switching between devices, distributed modes, mixed-…☆66Updated last year
- Large dataset storage format for Pytorch☆45Updated 3 years ago
- Distributed ML Optimizer☆31Updated 3 years ago
- a lightweight transformer library for PyTorch☆71Updated 2 years ago
- A Ray-based data loader with per-epoch shuffling and configurable pipelining, for shuffling and loading training data for distributed tra…☆18Updated last year
- PyTorch centric eager mode debugger☆43Updated 2 months ago
- Torch Distributed Experimental☆115Updated last month
- A collection of optimizers, some arcane others well known, for Flax.☆29Updated 3 years ago
- Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …☆61Updated 2 years ago
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆34Updated 2 months ago
- Some microbenchmarks and design docs before commencement☆12Updated 3 years ago
- Context Manager to profile the forward and backward times of PyTorch's nn.Module☆83Updated 11 months ago
- benchmarking some transformer deployments☆26Updated last year
- Example python package with pybind11 cpp extension☆57Updated 3 years ago
- A user-friendly tool chain that enables the seamless execution of ONNX models using JAX as the backend.☆94Updated this week
- Customized matrix multiplication kernels☆53Updated 2 years ago
- Productionize machine learning predictions, with ONNX or without☆66Updated 8 months ago
- pytest plugin for a better developer experience when working with the PyTorch test suite☆43Updated 2 years ago
- ☆18Updated 11 months ago
- Make triton easier☆39Updated 3 months ago
- Experiment of using Tangent to autodiff triton☆66Updated 7 months ago
- ☆25Updated 3 years ago
- CUDA and Triton implementations of Flash Attention with SoftmaxN.☆66Updated 3 months ago
- Multidimensional indexing for tensors☆108Updated last year
- Better bindings for Python☆17Updated last year
- DL Dataloader Benchmarks☆18Updated last week
- A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…☆145Updated this week
- Stride visualizations☆36Updated 6 years ago
- Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.☆29Updated 3 weeks ago