A simple but instructive implementation of DP, TP, FSDP, FSDP+TP using pytorch distributed primitives
☆24Apr 12, 2026Updated 5 months ago
Alternatives and similar repositories for pytorch-distributed-training-from-scratch
Users that are interested in pytorch-distributed-training-from-scratch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆15Sep 6, 2026Updated last week
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆38Dec 3, 2023Updated 2 years ago
- A coding agent built on LLM☆37Jul 4, 2026Updated 2 months ago
- Integrates Imbue's Cost Aware pareto-Region Bayesian Search (CARBS) with Weights and Biases (WanDB)☆12Mar 17, 2025Updated last year
- Code companion for the RL Post-Training Handbook - training reasoning models on a single GPU☆20Jan 30, 2026Updated 7 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- vLLM + Qwen3.6-27B (BF16) OpenAI-compatible inference server on AMD Strix Halo (Ryzen AI Max+ 395, gfx1151). Vision input, 256K context, …☆17Apr 26, 2026Updated 4 months ago
- Tries to UI development. Clone of https://www.perplexity.ai/☆11Sep 30, 2023Updated 2 years ago
- ☆14Sep 4, 2024Updated 2 years ago
- Centralized cooperative reinforcement learning☆13Jan 8, 2023Updated 3 years ago
- KV cache compression via sparse coding☆18Oct 26, 2025Updated 10 months ago
- Implementation and explorations into Blackbox Gradient Sensing (BGS), an evolutionary strategies approach proposed in a Google Deepmind p…☆20Apr 17, 2026Updated 4 months ago
- A neural network library written in jax☆14Feb 3, 2025Updated last year
- Multi-agent Reinforcement Learning game using Advantage Actor Critic (A2C) algorithm☆14Sep 26, 2023Updated 2 years ago
- Benchmark tests supporting the TiledCUDA library.☆19Nov 19, 2024Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Jax/Flax rewrite of Karpathy's nanoGPT☆66Feb 15, 2023Updated 3 years ago
- 🔍📃 LLM-powered PDF Table Extractor☆19Jun 26, 2025Updated last year
- Flash Attention in ~100 lines of CUDA (forward pass only)☆12Jun 10, 2024Updated 2 years ago
- ☆11May 2, 2023Updated 3 years ago
- Recursively generate descriptions of every file in a directory then append that description to Nushell's ls.☆16Oct 7, 2025Updated 11 months ago
- ClickModels for Search Engines Implemented on top of Cython.☆13Jun 9, 2021Updated 5 years ago
- A test for RL application on f1tenth gym environment☆11Apr 10, 2023Updated 3 years ago
- Efficient computer use agent powered by Meta Llama 4 Maverick☆46May 11, 2026Updated 4 months ago
- A simple docker compose setup that works (in limited testing) on Blackwell cards☆15Oct 13, 2025Updated 11 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆36Updated this week
- 方便扩展的Cuda算子理解和优化框架，仅用在学习使用☆18Jun 13, 2024Updated 2 years ago
- Mini RL Lab☆16Jun 17, 2024Updated 2 years ago
- An implementation of AlphaZero and MCTS with neural networks for Tetris☆22Jul 7, 2026Updated 2 months ago
- Compiling strategy guides into reward functions for reinforcement learning. Uses Claude Vision to extract unit tests from game guides, …☆38Jan 30, 2026Updated 7 months ago
- Tensor parallelism is all you need. Run LLMs on an AI cluster at home using any device. Distribute the workload, divide RAM usage, and in…☆18Nov 11, 2024Updated last year
- A lightweight Ethernet MAC Controller IP for FPGA prototyping☆14Oct 19, 2020Updated 5 years ago
- A conversational voice-to-voice open-weights LLM-powered assistant designed to run on high-end consumer or workstation class hardware☆75Jul 6, 2026Updated 2 months ago
- clear single-file JAX implementations of common RL algorithms☆15Sep 5, 2021Updated 5 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- This is a repo covers ai research papers pseudocodes☆18Jun 20, 2023Updated 3 years ago
- zero-code hyperparameters optimization framework☆14Jan 25, 2024Updated 2 years ago
- Production-grade Agent Skill for TypeScript, React & Next.js — decision guides, hard rules, and debugging playbooks for AI coding agents …☆20Updated this week
- Flash Attention from scratch, tiled CUDA forward kernel, online softmax with running max and correction factor, recomputation trick in ba…☆19Mar 6, 2026Updated 6 months ago
- TensorRT-in-Action 是一个 GitHub 代码库，提供了使用 TensorRT 的代码示例，并有对应 Jupyter Notebook。☆15Jun 1, 2023Updated 3 years ago
- Adaptation of titans-pytorch to llama models on HF☆25Mar 6, 2025Updated last year
- Multiple GEMM operators are constructed with cutlass to support LLM inference.☆20Aug 3, 2025Updated last year