Alternatives and similar repositories for weak-to-strong:

Users that are interested in weak-to-strong are comparing it to the libraries listed below

• allenai / open-instruct
  ☆2,289Updated this week
• myshell-ai / JetMoE
  Reaching LLaMA2 Performance with 0.1M Dollars
  ☆965Updated 5 months ago
• microsoft / promptbench
  A unified evaluation framework for large language models
  ☆2,505Updated 2 months ago
• pytorch-labs / gpt-fast
  Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.
  ☆5,749Updated last month
• lucidrains / self-rewarding-lm-pytorch
  Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI
  ☆1,358Updated 9 months ago
• uclaml / SPIN
  The official implementation of Self-Play Fine-Tuning (SPIN)
  ☆1,099Updated 8 months ago
• jiaweizzhao / GaLore
  GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
  ☆1,481Updated 2 months ago
• openai / prm800k
  800,000 step-level correctness labels on LLM solutions to MATH problems
  ☆1,824Updated last year
• pytorch / torchtitan
  A PyTorch native library for large model training
  ☆3,091Updated this week
• XueFuzhao / OpenMoE
  A family of open-sourced Mixture-of-Experts (MoE) Large Language Models
  ☆1,425Updated 10 months ago
• facebookresearch / llm-transparency-tool
  LLM Transparency Tool (LLM-TT), an open-source interactive toolkit for analyzing internal workings of Transformer-based language models. …
  ☆789Updated last month
• allenai / OLMo
  Modeling, training, eval, and inference code for OLMo
  ☆5,024Updated this week
• SakanaAI / evolutionary-model-merge
  Official repository of Evolutionary Optimization of Model Merging Recipes
  ☆1,250Updated last month
• openai / transformer-debugger
  ☆4,050Updated 7 months ago
• AnswerDotAI / fsdp_qlora
  Training LLMs with QLoRA + FSDP
  ☆1,436Updated 2 months ago
• facebookresearch / jepa
  PyTorch code and models for V-JEPA self-supervised learning from video.
  ☆2,745Updated 5 months ago
• open-compass / MixtralKit
  A toolkit for inference and evaluation of 'mixtral-8x7b-32kseqlen' from Mistral AI
  ☆765Updated last year
• facebookresearch / chameleon
  Repository for Meta Chameleon, a mixed-modal early-fusion foundation model from FAIR.
  ☆1,908Updated 5 months ago
• arcee-ai / mergekit
  Tools for merging pretrained large language models.
  ☆5,113Updated last week
• AI-Hypercomputer / maxtext
  A simple, performant and scalable Jax LLM!
  ☆1,587Updated this week
• google-deepmind / funsearch
  ☆752Updated 11 months ago
• tatsu-lab / alpaca_eval
  An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.
  ☆1,609Updated 3 weeks ago
• hao-ai-lab / LookaheadDecoding
  [ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
  ☆1,179Updated 3 months ago
• JShollaj / awesome-llm-interpretability
  A curated list of Large Language Model (LLM) Interpretability resources.
  ☆1,205Updated 3 weeks ago
• openai / simple-evals
  ☆2,180Updated last week
• FasterDecoding / Medusa
  Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads
  ☆2,371Updated 6 months ago
• huggingface / alignment-handbook
  Robust recipes to align language models with human and AI preferences
  ☆4,896Updated last month
• SqueezeAILab / LLMCompiler
  [ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling
  ☆1,580Updated 6 months ago
• eric-mitchell / direct-preference-optimization
  Reference implementation for DPO (Direct Preference Optimization)
  ☆2,323Updated 5 months ago
• huggingface / optimum-nvidia
  ☆913Updated this week