torch_remat fine-grained activation checkpointing API
☆26Nov 11, 2026Updated last week
Alternatives and similar repositories for remat
Users that are interested in remat are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This module defines a type system for distributed training code, based off of JAX's sharding in types, but adapted for the PyTorch ecosys…☆46Updated this week
- Flexible parameter sharding and distributed optimization utilities for PyTorch training☆16Nov 11, 2026Updated last week
- A sample pattern for running CI tests on Modal☆21Apr 12, 2025Updated last year
- ☆11Sep 9, 2026Updated 2 months ago
- A Model Agnostic function to directly remove specified layers from the LLM☆11May 23, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Local and global SPMD type system supporting erasure☆10Apr 24, 2026Updated 6 months ago
- An experimental implementation of compiler-driven automatic sharding of models across a given device mesh.☆103Updated this week
- ☆14Feb 5, 2022Updated 4 years ago
- ☆21Mar 3, 2025Updated last year
- Call commands safely by checking them rigorously against an allow-list☆22Nov 2, 2026Updated 2 weeks ago
- Memory Efficient Training Framework for Large Video Generation Model☆25Apr 22, 2024Updated 2 years ago
- MSLK (Meta Superintelligence Labs Kernels) is a collection of PyTorch GPU operator libraries that are designed and optimized for GenAI tr…☆168Updated this week
- Repo to submit jobs to the AMD cluster☆12Oct 30, 2024Updated 2 years ago
- Torch Distributed Experimental☆118Aug 5, 2024Updated 2 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- ☆15Updated this week
- Explorations into the proposed SDFT, Self-Distillation Enables Continual Learning, from Shenfeld et al. of MIT☆33Feb 6, 2026Updated 9 months ago
- ☆31Jan 7, 2026Updated 10 months ago
- See https://github.com/cuda-mode/triton-index/ instead!☆11May 8, 2024Updated 2 years ago
- LLM checkpointing for DeepSpeed/Megatron☆27Nov 30, 2025Updated 11 months ago
- ☆50Nov 10, 2023Updated 3 years ago
- Optimized primitives for collective multi-GPU communication☆11May 8, 2024Updated 2 years ago
- A framework for efficient model inference with omni-modality models☆30Nov 8, 2026Updated last week
- Hubble is a suite of fully open-source large language models (LLMs) for the scientific study of LLM memorization.☆24Apr 15, 2026Updated 7 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Simple async pool for any kind of resources☆15Jul 15, 2024Updated 2 years ago
- ☆31Oct 22, 2025Updated last year
- ☆13May 26, 2024Updated 2 years ago
- Portfolio template created strictly with HTML and CSS☆30Jun 22, 2024Updated 2 years ago
- A minimal and clean CSS Classless framework, designed to provide a lightweight and elegant foundation for web development. Keep your proj…☆39Nov 1, 2026Updated 2 weeks ago
- DL Dataloader Benchmarks☆20Jan 27, 2025Updated last year
- ☆11Mar 21, 2025Updated last year
- ☆44May 26, 2026Updated 5 months ago
- Make triton easier☆49Sep 3, 2026Updated 2 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Adversarial Tokenization☆39Nov 21, 2025Updated 11 months ago
- ☆16Sep 24, 2024Updated 2 years ago
- An extension of Py-Boost to probabilistic modelling☆24Jan 19, 2023Updated 3 years ago
- DPO, but faster 🚀☆51Dec 6, 2024Updated last year
- Infiniband verbs performance tests (fork of git://git.openfabrics.org/~grockah/perftest.git)☆21Jan 14, 2016Updated 10 years ago
- A curated list of vintage large language models — also called historical or time-capsule LLMs — trained from scratch on text from bounded…☆49May 9, 2026Updated 6 months ago
- ☆49Oct 24, 2026Updated 3 weeks ago
Are these results useful?