torch_remat fine-grained activation checkpointing API
☆23Oct 24, 2026Updated this week
Alternatives and similar repositories for remat
Users that are interested in remat are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This module defines a type system for distributed training code, based off of JAX's sharding in types, but adapted for the PyTorch ecosys…☆46Updated this week
- A sample pattern for running CI tests on Modal☆21Apr 12, 2025Updated last year
- A Model Agnostic function to directly remove specified layers from the LLM☆11May 23, 2024Updated 2 years ago
- Local and global SPMD type system supporting erasure☆10Apr 24, 2026Updated 6 months ago
- ☆14Feb 5, 2022Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆21Mar 3, 2025Updated last year
- Code for 'Answer Matching Outperforms Multiple Choice for Language Model Evaluation' paper☆20Jul 4, 2025Updated last year
- Memory Efficient Training Framework for Large Video Generation Model☆25Apr 22, 2024Updated 2 years ago
- Conveniently export torch.compile compiled products into self-contained Python files☆35Jun 5, 2026Updated 4 months ago
- Repo to submit jobs to the AMD cluster☆12Oct 30, 2024Updated 2 years ago
- A Suite for Parallel Inference of Diffusion Transformers (DiTs) on multi-GPU Clusters☆58May 3, 2026Updated 5 months ago
- ☆14Sep 29, 2026Updated last month
- ☆30Jan 7, 2026Updated 9 months ago
- Optimized primitives for collective multi-GPU communication☆11May 8, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A framework for efficient model inference with omni-modality models☆30Oct 20, 2026Updated last week
- Hubble is a suite of fully open-source large language models (LLMs) for the scientific study of LLM memorization.☆24Apr 15, 2026Updated 6 months ago
- A directive for including a Plotly figure in a Sphinx document.☆18Oct 25, 2022Updated 4 years ago
- Torch Distributed Experimental☆117Aug 5, 2024Updated 2 years ago
- A curated list of vintage large language models — also called historical or time-capsule LLMs — trained from scratch on text from bounded…☆44May 9, 2026Updated 5 months ago
- ☆31Oct 22, 2025Updated last year
- A minimal and clean CSS Classless framework, designed to provide a lightweight and elegant foundation for web development. Keep your proj…☆38Dec 21, 2024Updated last year
- Framework for Algorithmic Correctness Testing of Operators☆18Mar 9, 2026Updated 7 months ago
- ☆42May 26, 2026Updated 5 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- DL Dataloader Benchmarks☆20Jan 27, 2025Updated last year
- An extension of Py-Boost to probabilistic modelling☆24Jan 19, 2023Updated 3 years ago
- A lightweight, user-friendly data-plane for LLM training.☆43Sep 10, 2025Updated last year
- Simple RPC in C++, with Python binding☆27Apr 24, 2015Updated 11 years ago
- DPO, but faster 🚀☆51Dec 6, 2024Updated last year
- Infiniband verbs performance tests (fork of git://git.openfabrics.org/~grockah/perftest.git)☆21Jan 14, 2016Updated 10 years ago
- ☆49Updated this week
- 在线图书借阅系统 - 2017 THU OOP课大作业☆14Jul 1, 2018Updated 8 years ago
- utilities for batched llm calls with retries☆54Oct 14, 2026Updated 2 weeks ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Communication patterns for AI, built on top of NCCL device and host APIs☆72Updated this week
- GPU accelerated Perlin Noise in python☆11Oct 23, 2020Updated 6 years ago
- Diffusers++: State-of-the-art diffusion models for image and audio generation in PyTorch☆14Sep 18, 2024Updated 2 years ago
- Code for the paper: "Generalized Discrete Diffusion from Snapshots"☆14Apr 2, 2026Updated 6 months ago
- ☆12Aug 12, 2024Updated 2 years ago
- Code repository for the SOSP'25 paper DCP: Addressing Input Dynamism In Long-Context Training via Dynamic Context Parallelism.☆23Nov 28, 2025Updated 11 months ago
- ☆27Sep 10, 2026Updated last month