Alternatives and similar repositories for weak-to-strong:

Users that are interested in weak-to-strong are comparing it to the libraries listed below

• uclaml / SPIN
  The official implementation of Self-Play Fine-Tuning (SPIN)
  ☆1,143Updated 11 months ago
• myshell-ai / JetMoE
  Reaching LLaMA2 Performance with 0.1M Dollars
  ☆982Updated 8 months ago
• lucidrains / self-rewarding-lm-pytorch
  Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI
  ☆1,377Updated last year
• google-deepmind / funsearch
  ☆811Updated last year
• pytorch-labs / gpt-fast
  Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.
  ☆5,916Updated this week
• huggingface / optimum-nvidia
  ☆950Updated 2 months ago
• huggingface / alignment-handbook
  Robust recipes to align language models with human and AI preferences
  ☆5,130Updated 4 months ago
• microsoft / promptbench
  A unified evaluation framework for large language models
  ☆2,588Updated 2 months ago
• XueFuzhao / OpenMoE
  A family of open-sourced Mixture-of-Experts (MoE) Large Language Models
  ☆1,508Updated last year
• jiaweizzhao / GaLore
  GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
  ☆1,541Updated 5 months ago
• openai / prm800k
  800,000 step-level correctness labels on LLM solutions to MATH problems
  ☆1,973Updated last year
• dvlab-research / LongLoRA
  Code and documents of LongLoRA and LongAlpaca (ICLR 2024 Oral)
  ☆2,656Updated 8 months ago
• FasterDecoding / Medusa
  Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads
  ☆2,494Updated 9 months ago
• PKU-YuanGroup / MoE-LLaVA
  Mixture-of-Experts for Large Vision-Language Models
  ☆2,145Updated 4 months ago
• microsoft / ToRA
  ToRA is a series of Tool-integrated Reasoning LLM Agents designed to solve challenging mathematical reasoning problems by interacting wit…
  ☆1,058Updated last year
• facebookresearch / llm-transparency-tool
  LLM Transparency Tool (LLM-TT), an open-source interactive toolkit for analyzing internal workings of Transformer-based language models. …
  ☆816Updated 4 months ago
• jquesnelle / yarn
  YaRN: Efficient Context Window Extension of Large Language Models
  ☆1,463Updated last year
• Vahe1994 / AQLM
  Official Pytorch repository for Extreme Compression of Large Language Models via Additive Quantization https://arxiv.org/pdf/2401.06118.p…
  ☆1,248Updated this week
• princeton-nlp / MeZO
  [NeurIPS 2023] MeZO: Fine-Tuning Language Models with Just Forward Passes. https://arxiv.org/abs/2305.17333
  ☆1,099Updated last year
• spcl / graph-of-thoughts
  Official Implementation of "Graph of Thoughts: Solving Elaborate Problems with Large Language Models"
  ☆2,337Updated 4 months ago
• JShollaj / awesome-llm-interpretability
  A curated list of Large Language Model (LLM) Interpretability resources.
  ☆1,294Updated 3 months ago
• THUDM / AgentTuning
  AgentTuning: Enabling Generalized Agent Abilities for LLMs
  ☆1,420Updated last year
• open-compass / MixtralKit
  A toolkit for inference and evaluation of 'mixtral-8x7b-32kseqlen' from Mistral AI
  ☆768Updated last year
• S-LoRA / S-LoRA
  S-LoRA: Serving Thousands of Concurrent LoRA Adapters
  ☆1,816Updated last year
• allenai / OLMo
  Modeling, training, eval, and inference code for OLMo
  ☆5,489Updated last week
• Alpha-VLLM / LLaMA2-Accessory
  An Open-source Toolkit for LLM Development
  ☆2,768Updated 3 months ago
• SqueezeAILab / LLMCompiler
  [ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling
  ☆1,659Updated 9 months ago
• ezelikman / quiet-star
  Code for Quiet-STaR
  ☆730Updated 7 months ago
• arcee-ai / mergekit
  Tools for merging pretrained large language models.
  ☆5,556Updated last week
• anthropics / hh-rlhf
  Human preference data for "Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback"
  ☆1,719Updated last year