Alternatives and similar repositories for weak-to-strong

Users that are interested in weak-to-strong are comparing it to the libraries listed below

• uclaml / SPIN
  The official implementation of Self-Play Fine-Tuning (SPIN)
  ☆1,193Updated last year
• lucidrains / self-rewarding-lm-pytorch
  Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI
  ☆1,399Updated last year
• myshell-ai / JetMoE
  Reaching LLaMA2 Performance with 0.1M Dollars
  ☆988Updated last year
• microsoft / ToRA
  ToRA is a series of Tool-integrated Reasoning LLM Agents designed to solve challenging mathematical reasoning problems by interacting wit…
  ☆1,084Updated last year
• ise-uiuc / magicoder
  [ICML'24] Magicoder: Empowering Code Generation with OSS-Instruct
  ☆2,026Updated 9 months ago
• meta-pytorch / gpt-fast
  Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.
  ☆6,061Updated last week
• openai / prm800k
  800,000 step-level correctness labels on LLM solutions to MATH problems
  ☆2,041Updated 2 years ago
• jiaweizzhao / GaLore
  GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
  ☆1,591Updated 10 months ago
• openai / transformer-debugger
  ☆4,088Updated last year
• AnswerDotAI / fsdp_qlora
  Training LLMs with QLoRA + FSDP
  ☆1,526Updated 9 months ago
• google-deepmind / funsearch
  ☆923Updated last year
• JShollaj / awesome-llm-interpretability
  A curated list of Large Language Model (LLM) Interpretability resources.
  ☆1,400Updated 2 months ago
• microsoft / promptbench
  A unified evaluation framework for large language models
  ☆2,699Updated 3 weeks ago
• dvmazur / mixtral-offloading
  Run Mixtral-8x7B models in Colab or consumer desktops
  ☆2,315Updated last year
• XueFuzhao / OpenMoE
  A family of open-sourced Mixture-of-Experts (MoE) Large Language Models
  ☆1,583Updated last year
• tatsu-lab / alpaca_eval
  An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.
  ☆1,840Updated 3 weeks ago
• openai / automated-interpretability
  ☆1,031Updated last year
• SakanaAI / evolutionary-model-merge
  Official repository of Evolutionary Optimization of Model Merging Recipes
  ☆1,356Updated 9 months ago
• facebookresearch / llm-transparency-tool
  LLM Transparency Tool (LLM-TT), an open-source interactive toolkit for analyzing internal workings of Transformer-based language models. …
  ☆830Updated 8 months ago
• huggingface / alignment-handbook
  Robust recipes to align language models with human and AI preferences
  ☆5,329Updated last month
• AI-Hypercomputer / maxtext
  A simple, performant and scalable Jax LLM!
  ☆1,885Updated this week
• ezelikman / quiet-star
  Code for Quiet-STaR
  ☆739Updated last year
• Xwin-LM / Xwin-LM
  Xwin-LM: Powerful, Stable, and Reproducible LLM Alignment
  ☆1,041Updated last year
• allenai / open-instruct
  AllenAI's post-training codebase
  ☆3,144Updated this week
• huggingface / optimum-nvidia
  ☆997Updated 6 months ago
• jquesnelle / yarn
  YaRN: Efficient Context Window Extension of Large Language Models
  ☆1,589Updated last year
• google / gemma_pytorch
  The official PyTorch implementation of Google's Gemma models
  ☆5,534Updated 3 months ago
• allenai / OLMo
  Modeling, training, eval, and inference code for OLMo
  ☆5,924Updated this week
• dvlab-research / MGM
  Official repo for "Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models"
  ☆3,310Updated last year
• anthropics / hh-rlhf
  Human preference data for "Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback"
  ☆1,777Updated 2 months ago