Alternatives and similar repositories for pipelining-sft

Users that are interested in pipelining-sft are comparing it to the libraries listed below

• tilde-research / MoMoE-impl
  Memory optimized Mixture of Experts
  ☆72Updated 5 months ago
• HazyResearch / cartridges
  Storing long contexts in tiny caches with self-study
  ☆228Updated 3 weeks ago
• ServiceNow / PipelineRL
  A scalable asynchronous reinforcement learning implementation with in-flight weight updates.
  ☆340Updated last week
• microsoft / ArchScale
  Simple & Scalable Pretraining for Neural Architecture Research
  ☆305Updated 3 weeks ago
• NVIDIA-NeMo / Automodel
  Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support
  ☆214Updated this week
• frankxwang / dpo-prefix-sharing
  DPO, but faster 🚀
  ☆46Updated last year
• open-tinker / OpenTinker
  OpenTinker is an RL-as-a-Service infrastructure for foundation models
  ☆424Updated this week
• siyan-zhao / prepacking
  The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …
  ☆60Updated last year
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆190Updated 9 months ago
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆48Updated last year
• snowflakedb / ArcticTraining
  ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs)
  ☆263Updated this week
• RiddleHe / llm-interp
  A collection of lightweight interpretability scripts to understand how LLMs think
  ☆74Updated this week
• letta-ai / sleep-time-compute
  accompanying material for sleep-time compute paper
  ☆118Updated 7 months ago
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆131Updated last year
• ServiceNow / Fast-LLM
  Accelerating your LLM training to full speed! Made with ❤️ by ServiceNow Research
  ☆273Updated this week
• wdlctc / mini-s
  ☆54Updated last year
• OpenEvaByte / evabyte
  EvaByte: Efficient Byte-level Language Models at Scale
  ☆111Updated 8 months ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆59Updated 2 months ago
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆104Updated 7 months ago
• collinear-ai / spider
  Streamline on-policy/off-policy distillation workflows in a few lines of code
  ☆84Updated this week
• facebookresearch / fastgen
  Simple high-throughput inference library
  ☆153Updated 7 months ago
• Danau5tin / calculator_agent_rl
  Training an LLM to use a calculator with multi-turn reinforcement learning, achieving a **62% absolute increase in evaluation accuracy**.
  ☆64Updated 7 months ago
• nahidalam / maya
  Maya: An Instruction Finetuned Multilingual Multimodal Model using Aya
  ☆124Updated 4 months ago
• casper-hansen / OpenCoconut
  OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.
  ☆174Updated 11 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆62Updated last year
• Noumena-Network / nmoe
  MoE training for Me and You and maybe other people
  ☆298Updated last week
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆108Updated 9 months ago
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆107Updated 9 months ago
• google-deepmind / asyncdiloco
  ☆47Updated last year
• facebookresearch / llm-speedrunner
  The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…
  ☆122Updated 2 months ago