LLM checkpointing for DeepSpeed/Megatron
☆27Nov 30, 2025Updated 11 months ago
Alternatives and similar repositories for datastates-llm
Users that are interested in datastates-llm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆58Jan 25, 2021Updated 5 years ago
- Official implementation of ICML 2024 paper "ExCP: Extreme LLM Checkpoint Compression via Weight-Momentum Joint Shrinking".☆48Jul 12, 2024Updated 2 years ago
- ☆10Sep 12, 2024Updated 2 years ago
- A resilient distributed training framework☆101Jul 24, 2026Updated 3 months ago
- ☆13Aug 28, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A lightweight, user-friendly data-plane for LLM training.☆43Sep 10, 2025Updated last year
- VaniDL is an tool for analyzing I/O patterns and behavior with Deep Learning Applications.☆10Jul 8, 2022Updated 4 years ago
- Accelerating AI Training and Inference from Storage Perspective (Must-read Papers on Storage for AI)☆67Updated this week
- ☆15Jan 21, 2023Updated 3 years ago
- DL Dataloader Benchmarks☆20Jan 27, 2025Updated last year
- A sample pattern for running CI tests on Modal☆21Apr 12, 2025Updated last year
- Code for SIGKDD2025 paper: An Efficient Diffusion-based Non-Autoregressive Solver for Traveling Salesman Problem☆16Jan 28, 2025Updated last year
- ☆45Jun 13, 2025Updated last year
- QuantumDNA is an open-source Python package for simulating exciton and charge transfer in DNA using quantum mechanical methods. Designed …☆13Sep 23, 2026Updated last month
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Megatron-LM setup in the smol-cluster☆12Aug 26, 2024Updated 2 years ago
- Call commands safely by checking them rigorously against an allow-list☆20Sep 21, 2026Updated last month
- Code for 'Answer Matching Outperforms Multiple Choice for Language Model Evaluation' paper☆20Jul 4, 2025Updated last year
- torch_remat fine-grained activation checkpointing API☆23Updated this week
- A tracing tool to analyze the I/O behavior of a program.☆12Sep 25, 2019Updated 7 years ago
- ☆15Mar 29, 2020Updated 6 years ago
- ☆16Feb 6, 2024Updated 2 years ago
- Enabling Live Migration for Computational Notebooks.☆13Mar 11, 2024Updated 2 years ago
- Argobots bindings for the Mercury RPC library☆27Oct 6, 2026Updated 3 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆30Jan 7, 2026Updated 9 months ago
- ☆49Oct 24, 2026Updated last week
- High-Throughput, Cost-Effective Billion-Scale Vector Search with a Single GPU [SIGMOD'26]☆32Oct 20, 2026Updated last week
- ☆15Apr 20, 2022Updated 4 years ago
- A framework for efficient model inference with omni-modality models☆30Oct 20, 2026Updated last week
- Hubble is a suite of fully open-source large language models (LLMs) for the scientific study of LLM memorization.☆24Apr 15, 2026Updated 6 months ago
- [ACL 2026 Oral] Official Implementation of the paper "Deriving Character Logic from Storyline as Codified Decision Trees"☆37Jul 6, 2026Updated 3 months ago
- ☆38Jan 15, 2021Updated 5 years ago
- Google DeepMind: Mixture of Depths Unofficial Implementation.☆12May 29, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Repo for distillation of chemical knowledge into python code☆13Sep 28, 2026Updated last month
- DLL注入工具☆13Nov 9, 2020Updated 5 years ago
- Portfolio template created strictly with HTML and CSS☆30Jun 22, 2024Updated 2 years ago
- ☆10Apr 5, 2025Updated last year
- ☆16Apr 7, 2024Updated 2 years ago
- Conveniently export torch.compile compiled products into self-contained Python files☆35Jun 5, 2026Updated 4 months ago
- ☆33May 16, 2022Updated 4 years ago