Simple and efficient DeepSeek V3 SFT using pipeline parallel and expert parallel, with both FP8 and BF16 trainings
☆117Jul 27, 2025Updated 9 months ago
Alternatives and similar repositories for pipelining-sft
Users that are interested in pipelining-sft are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A fast, local, and secure approach for training LLMs for coding tasks using GRPO with WebAssembly and interpreter feedback.☆42Apr 4, 2025Updated last year
- A scalable asynchronous reinforcement learning implementation with in-flight weight updates.☆409Updated this week
- ☆93Jul 5, 2024Updated last year
- Python package for compressing floating-point PyTorch tensors☆13Jul 22, 2024Updated last year
- Train your own SOTA deductive reasoning model☆110Mar 6, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆17Apr 7, 2025Updated last year
- Multi-Agent Verification: Scaling Test-Time Compute with Multiple Verifiers☆29Mar 1, 2025Updated last year
- ☆133May 13, 2026Updated last week
- ☆14Apr 8, 2026Updated last month
- Code for SGP 2025 Graduate School tutorial "Deep Learning on Meshes and Point Clouds"☆38May 2, 2026Updated 2 weeks ago
- [NeurIPS 2025 Spotlight] Scaling Computer-Use Grounding via UI Decomposition and Synthesis☆164Nov 6, 2025Updated 6 months ago
- Scalable toolkit for efficient model reinforcement☆1,635Updated this week
- Website with current metrics on the fastest AI models.☆43Nov 13, 2024Updated last year
- ☆35Nov 11, 2025Updated 6 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Train speculative decoding models effortlessly and port them smoothly to SGLang serving.☆832Apr 2, 2026Updated last month
- Simple and efficient pytorch-native transformer training and inference (batched)☆78Apr 2, 2024Updated 2 years ago
- Combining SOAP and MUON☆21Feb 11, 2025Updated last year
- A lightweight reinforcement learning framework that integrates seamlessly into your codebase, empowering developers to focus on algorithm…☆104Aug 25, 2025Updated 8 months ago
- Super-Efficient RLHF Training of LLMs with Parameter Reallocation☆335Apr 24, 2025Updated last year
- j1-micro (1.7B) & j1-nano (600M) are absurdly tiny but mighty reward models.☆104Jul 19, 2025Updated 10 months ago
- Accelerating MoE with IO and Tile-aware Optimizations☆684May 14, 2026Updated last week
- ☆24Jun 18, 2024Updated last year
- Gantry provides an API that streamlines running experiments in Beaker☆33Apr 8, 2026Updated last month
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆95Oct 30, 2025Updated 6 months ago
- Automated Theorem Prover inspired by Aletheia. Claude Code for mathematicians.☆76Apr 20, 2026Updated last month
- Spectral Sphere Optimizer☆116Mar 23, 2026Updated last month
- A vim plugin used to auto insert code comment header block☆16Apr 4, 2013Updated 13 years ago
- utilities for batched llm calls with retries☆50Apr 23, 2026Updated 3 weeks ago
- Generate debug symbols on the fly for your RE needs☆17Apr 30, 2026Updated 3 weeks ago
- ☆27Nov 13, 2025Updated 6 months ago
- implementation of https://arxiv.org/pdf/2312.09299☆21Jul 3, 2024Updated last year
- ☆12Sep 26, 2019Updated 6 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆102May 14, 2026Updated last week
- Inference-time scaling for LLMs-as-a-judge.☆339Nov 5, 2025Updated 6 months ago
- FlexAttention w/ FlashAttention3 Support☆27Oct 5, 2024Updated last year
- A Lightweight Library for AI Observability☆254Feb 20, 2025Updated last year
- OpenTinker is an RL-as-a-Service infrastructure for foundation models☆672Mar 21, 2026Updated 2 months ago
- A file-backed dictionary for Python☆12Aug 15, 2022Updated 3 years ago
- One-stop shop for running and fine-tuning transformer-based language models for retrieval☆65May 1, 2026Updated 2 weeks ago