A simple but instructive implementation of DP, TP, FSDP, FSDP+TP using pytorch distributed primitives
☆24Apr 12, 2026Updated 7 months ago
Alternatives and similar repositories for pytorch-distributed-training-from-scratch
Users that are interested in pytorch-distributed-training-from-scratch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆16Oct 25, 2026Updated 3 weeks ago
- ☆15Sep 6, 2026Updated 2 months ago
- A live, local dashboard to browse, search, resume & manage every Claude Code session on your machine — full conversation transcripts, an …☆13Nov 10, 2026Updated last week
- One RL training loop that runs CartPole on a laptop and disaggregated async RLVR on a GPU cluster. About 1,800 lines across 7 files. No R…☆13Oct 8, 2026Updated last month
- ☆12Apr 1, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Flexible plugin for Logseq that annotates deadline/schedule times with a countdown or time difference☆19Mar 22, 2023Updated 3 years ago
- ☆10Aug 20, 2025Updated last year
- JAX implementation of NeuroEvolution of Augmenting Topologies (Neat)☆11Jul 6, 2024Updated 2 years ago
- From the world's largest port to the nation's first freeways to pioneering aqueducts, California's history has been defined by visionary …☆13Updated this week
- GLM-5.3-Flash with 152 of 288 experts per layer (RCO), for coding and agentic use on a home PC: recipe, mask, patches, evaluation harness☆15Oct 31, 2026Updated 2 weeks ago
- Powerful Asynchronous Multi agent framework built from scratch in python supporting RAG and MCP compatibilities.☆12Aug 26, 2025Updated last year
- wc -w but avx2☆22Nov 30, 2022Updated 3 years ago
- ☆15Oct 18, 2026Updated last month
- Web GUI for LLM assisted prose writing☆32Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Python implementation of a few speech intelligibility prediction algorithms☆15May 29, 2024Updated 2 years ago
- Code for paper "Understanding Generalization, Robustness, and Interpretability in Low-Capacity Neural Networks"☆13Jul 24, 2025Updated last year
- PyTorch Implementation of GPT-2☆41Sep 4, 2024Updated 2 years ago
- A CUDA Python experiment demonstrating kernel fusion by combining ReLU and LayerNorm into a single GPU pass and comparing it against the …☆14Feb 28, 2026Updated 8 months ago
- Four ways to fake surface relief. Inspired by Crimson Desert☆17Aug 17, 2026Updated 3 months ago
- Lightning-fast kernel dispatch for ROCm. Retained command replay over public ROCr/HSA queues.☆15Oct 11, 2026Updated last month
- Tries to UI development. Clone of https://www.perplexity.ai/☆11Sep 30, 2023Updated 3 years ago
- Scripts to setup a two-node llama.cpp cluster on NVIDIA DGX Spark (GB10) hardware.☆12May 10, 2026Updated 6 months ago
- Official OCR mini-bench repository for public use. Typescript Version.☆12Jul 3, 2026Updated 4 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A collection of my from-scratch implementation of various models deployed on HF Spaces☆14Nov 3, 2026Updated 2 weeks ago
- A 21M-parameter LM with a 16.8M-row product-key memory: as good as a 114M dense model and runs with the table on an SSD. Triton kernels f…☆16Oct 23, 2026Updated 3 weeks ago
- Reduce kernel based on CUTLASS CuTe and TMA.☆12Sep 25, 2025Updated last year
- Multitouch counter for iPhone / iPod touch / iPad☆10Apr 6, 2010Updated 16 years ago
- ChatGPT-like AI that runs 100% locally on your hardware. No subscriptions, no cloud, complete privacy. Multi-agent swarm + 10 MCP tools +…☆11Feb 21, 2026Updated 8 months ago
- Differential-KV (DKV) is a sparse KV-cache inference runtime designed for high-efficiency, memory-bounded long-context Large Language Mod…☆21Oct 30, 2026Updated 2 weeks ago
- ☆15Jul 10, 2026Updated 4 months ago
- ☆17Nov 16, 2025Updated last year
- Qwen Image 2.1 Turbo Prediction and Strix Halo attention for ComfyUI☆18Sep 24, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Official Implementation for Pre-print "T2MLR: Transformer with Temporal Middle-Layer Recurrence"☆13Sep 8, 2026Updated 2 months ago
- Soft Actor-Critic implementation with SOTA model-free extension (REDQ) and SOTA model-based extension (MBPO).☆16Feb 21, 2021Updated 5 years ago
- ☆14Sep 4, 2024Updated 2 years ago
- A modular framework of 22 AI agents, each defined by strict, human-readable YAML architectures. Six classes cover strategic planning, kno…☆13Mar 22, 2026Updated 7 months ago
- Privacy-first Chrome MV3 extension that uses Chrome’s on-device Gemini Nano for chat and one-click page summaries—no network calls.☆13Dec 7, 2025Updated 11 months ago
- Implementation and explorations into Blackbox Gradient Sensing (BGS), an evolutionary strategies approach proposed in a Google Deepmind p…☆20Apr 17, 2026Updated 7 months ago
- A neural network library written in jax☆14Feb 3, 2025Updated last year
Are these results useful?