A simple but instructive implementation of DP, TP, FSDP, FSDP+TP using pytorch distributed primitives
☆19Apr 12, 2026Updated 3 months ago
Alternatives and similar repositories for pytorch-distributed-training-from-scratch
Users that are interested in pytorch-distributed-training-from-scratch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The curation engine for AI image datasets.☆29Updated this week
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆38Dec 3, 2023Updated 2 years ago
- ☆30Dec 15, 2025Updated 7 months ago
- vLLM + Qwen3.6-27B (BF16) OpenAI-compatible inference server on AMD Strix Halo (Ryzen AI Max+ 395, gfx1151). Vision input, 256K context, …☆15Apr 26, 2026Updated 2 months ago
- Integrates Imbue's Cost Aware pareto-Region Bayesian Search (CARBS) with Weights and Biases (WanDB)☆12Mar 17, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆11Jan 24, 2025Updated last year
- A machine learning solution for extracting key entity values (weight, volume, dimensions) from product images.☆18Sep 17, 2024Updated last year
- Tries to UI development. Clone of https://www.perplexity.ai/☆11Sep 30, 2023Updated 2 years ago
- ☆14Sep 4, 2024Updated last year
- Benchmark tests supporting the TiledCUDA library.☆19Nov 19, 2024Updated last year
- This is a simple automated license plate detector developed in C++ via OpenCV.☆11Sep 26, 2020Updated 5 years ago
- Simple and efficient memory pool is implemented with C++11.☆10Jun 2, 2022Updated 4 years ago
- Repository of useful 'stuff' for the MineRL BASALT Challenge☆17Mar 21, 2023Updated 3 years ago
- pytorch版基于gpt+nezha的中文多轮Cdial☆11Oct 22, 2022Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Native C/C++ core for ToolNeuron — JNI + llama.cpp bindings for fast, private, on‑device LLM inference on Android.☆30Dec 14, 2025Updated 7 months ago
- ☆20Jul 4, 2025Updated last year
- Centralized cooperative reinforcement learning☆13Jan 8, 2023Updated 3 years ago
- A neural network library written in jax☆14Feb 3, 2025Updated last year
- This repo implements and trains DallE-1 on a synthetically generated dataset which has colored mnist images on texture/solid background a…☆14Oct 30, 2024Updated last year
- Real-world AI engineering dataset creation, SFT fine-tuning, and GRPO alignment ETL pipeline.☆34Aug 27, 2025Updated 10 months ago
- Jax/Flax rewrite of Karpathy's nanoGPT☆66Feb 15, 2023Updated 3 years ago
- Accompanying repo for the paper - High-speed Autonomous Racing using Trajectory-aided Deep Reinforcement Learning☆18Jan 17, 2024Updated 2 years ago
- PyTorch Implementation of GPT-2☆35Sep 4, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆11May 2, 2023Updated 3 years ago
- Production-grade TypeScript patterns for React & Next.js — Agent Skill for Claude Code, Cursor, Codex. 17 modules, 4K+ lines covering typ…☆15Apr 19, 2026Updated 2 months ago
- ClickModels for Search Engines Implemented on top of Cython.☆13Jun 9, 2021Updated 5 years ago
- A conversational voice-to-voice open-weights LLM-powered assistant designed to run on high-end consumer or workstation class hardware☆71Jul 6, 2026Updated last week
- CPU/GPU Implicit & Explicit Finite Element Solver for Large Strains☆25Feb 20, 2026Updated 4 months ago
- Gives agents a real browser. URL in, pruned snapshot out. Replaces Playwright, Selenium, Puppeteer. Zero deps, zero wasted tokens.☆41Updated this week
- Mini RL Lab☆16Jun 17, 2024Updated 2 years ago
- Tensor parallelism is all you need. Run LLMs on an AI cluster at home using any device. Distribute the workload, divide RAM usage, and in…☆18Nov 11, 2024Updated last year
- clear single-file JAX implementations of common RL algorithms☆15Sep 5, 2021Updated 4 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- This is a repo covers ai research papers pseudocodes☆18Jun 20, 2023Updated 3 years ago
- 简单易用的vim配置☆13Nov 11, 2023Updated 2 years ago
- repo of paper implementations☆20Feb 25, 2025Updated last year
- Code for AAAI 2023 accepted paper titled "Knowledge-Bridged Causal Interaction Network for Causal Emotion Entailment"☆14May 6, 2023Updated 3 years ago
- Flash Attention from scratch, tiled CUDA forward kernel, online softmax with running max and correction factor, recomputation trick in ba…☆18Mar 6, 2026Updated 4 months ago
- zero-code hyperparameters optimization framework☆14Jan 25, 2024Updated 2 years ago
- ☆23Feb 24, 2023Updated 3 years ago