Alternatives and similar repositories for weak-to-strong

Users that are interested in weak-to-strong are comparing it to the libraries listed below

• lucidrains / self-rewarding-lm-pytorch
  Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI
  ☆1,383Updated last year
• uclaml / SPIN
  The official implementation of Self-Play Fine-Tuning (SPIN)
  ☆1,155Updated last year
• microsoft / promptbench
  A unified evaluation framework for large language models
  ☆2,616Updated last month
• openai / transformer-debugger
  ☆4,083Updated 11 months ago
• microsoft / ToRA
  ToRA is a series of Tool-integrated Reasoning LLM Agents designed to solve challenging mathematical reasoning problems by interacting wit…
  ☆1,071Updated last year
• huggingface / alignment-handbook
  Robust recipes to align language models with human and AI preferences
  ☆5,196Updated last month
• myshell-ai / JetMoE
  Reaching LLaMA2 Performance with 0.1M Dollars
  ☆979Updated 10 months ago
• pytorch-labs / gpt-fast
  Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.
  ☆5,960Updated last month
• openai / prm800k
  800,000 step-level correctness labels on LLM solutions to MATH problems
  ☆1,999Updated last year
• JShollaj / awesome-llm-interpretability
  A curated list of Large Language Model (LLM) Interpretability resources.
  ☆1,336Updated 5 months ago
• jiaweizzhao / GaLore
  GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
  ☆1,560Updated 7 months ago
• facebookresearch / llm-transparency-tool
  LLM Transparency Tool (LLM-TT), an open-source interactive toolkit for analyzing internal workings of Transformer-based language models. …
  ☆819Updated 5 months ago
• allenai / OLMo
  Modeling, training, eval, and inference code for OLMo
  ☆5,634Updated this week
• AnswerDotAI / fsdp_qlora
  Training LLMs with QLoRA + FSDP
  ☆1,479Updated 6 months ago
• google-deepmind / funsearch
  ☆859Updated last year
• openai / automated-interpretability
  ☆1,018Updated last year
• facebookresearch / jepa
  PyTorch code and models for V-JEPA self-supervised learning from video.
  ☆3,005Updated 3 months ago
• tatsu-lab / alpaca_eval
  An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.
  ☆1,754Updated 5 months ago
• SqueezeAILab / LLMCompiler
  [ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling
  ☆1,687Updated 10 months ago
• PKU-YuanGroup / MoE-LLaVA
  Mixture-of-Experts for Large Vision-Language Models
  ☆2,168Updated 5 months ago
• AI-Hypercomputer / maxtext
  A simple, performant and scalable Jax LLM!
  ☆1,734Updated this week
• huggingface / optimum-nvidia
  ☆965Updated 3 months ago
• THUDM / AgentTuning
  AgentTuning: Enabling Generalized Agent Abilities for LLMs
  ☆1,438Updated last year
• spcl / graph-of-thoughts
  Official Implementation of "Graph of Thoughts: Solving Elaborate Problems with Large Language Models"
  ☆2,374Updated 5 months ago
• dvmazur / mixtral-offloading
  Run Mixtral-8x7B models in Colab or consumer desktops
  ☆2,311Updated last year
• allenai / dolma
  Data and tools for generating and inspecting OLMo pre-training data.
  ☆1,220Updated last week
• ezelikman / quiet-star
  Code for Quiet-STaR
  ☆732Updated 9 months ago
• Alpha-VLLM / LLaMA2-Accessory
  An Open-source Toolkit for LLM Development
  ☆2,779Updated 4 months ago
• EleutherAI / pythia
  The hub for EleutherAI's work on interpretability and learning dynamics
  ☆2,500Updated last week
• pytorch / torchtitan
  A PyTorch native platform for training generative AI models
  ☆3,838Updated this week