srush / awesome-o1

Related projects ⓘ

Alternatives and complementary repositories for awesome-o1

• ContextualAI / HALOs
  A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).
  ☆744Updated this week
• allenai / reward-bench
  RewardBench: the first evaluation tool for reward models.
  ☆431Updated 3 weeks ago
• jzhang38 / EasyContext
  Memory optimization and training recipes to extrapolate language models' context length to 1 million tokens, with minimal hardware.
  ☆647Updated last month
• huggingface / cosmopedia
  ☆451Updated 3 weeks ago
• NVIDIA / NeMo-Aligner
  Scalable toolkit for efficient model alignment
  ☆620Updated this week
• open-thought / system-2-research
  System 2 Reasoning Link Collection
  ☆693Updated 3 weeks ago
• trotsky1997 / MathBlackBox
  ☆935Updated 2 weeks ago
• FranxYao / Long-Context-Data-Engineering
  Implementation of paper Data Engineering for Scaling Language Models to 128K Context
  ☆438Updated 8 months ago
• ruizheliUOA / Awesome-Interpretability-in-Large-Language-Models
  This repository collects all relevant resources about interpretability in LLMs
  ☆288Updated 2 weeks ago
• HazyResearch / aisys-building-blocks
  Building blocks for foundation models.
  ☆394Updated 10 months ago
• huggingface / lighteval
  Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
  ☆811Updated this week
• huggingface / nanotron
  Minimalistic large language model 3D-parallelism training
  ☆1,260Updated this week
• SimpleBerry / LLaMA-O1
  Large Reasoning Models
  ☆580Updated this week
• openai / sparse_autoencoder
  ☆328Updated 4 months ago
• princeton-nlp / SimPO
  [NeurIPS 2024] SimPO: Simple Preference Optimization with a Reference-Free Reward
  ☆714Updated 2 weeks ago
• srush / LLM-Training-Puzzles
  What would you do with 1000 H100s...
  ☆903Updated 10 months ago
• mlfoundations / open_lm
  A repository for research on medium sized language models.
  ☆479Updated this week
• maitrix-org / llm-reasoners
  A library for advanced large language model reasoning
  ☆1,442Updated last week
• allenai / OLMoE
  OLMoE: Open Mixture-of-Experts Language Models
  ☆460Updated this week
• allenai / open-instruct
  ☆1,271Updated this week
• lucidrains / ring-attention-pytorch
  Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch
  ☆476Updated 3 weeks ago
• justinchiu / openlogprobs
  Extract full next-token probabilities via language model APIs
  ☆229Updated 8 months ago
• ezelikman / quiet-star
  Code for Quiet-STaR
  ☆651Updated 3 months ago
• xfactlab / orpo
  Official repository for ORPO
  ☆421Updated 5 months ago
• princeton-nlp / LLM-Shearing
  [ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
  ☆558Updated 8 months ago
• stanfordnlp / pyreft
  ReFT: Representation Finetuning for Language Models
  ☆1,159Updated 2 weeks ago
• allenai / fm-cheatsheet
  Website for hosting the Open Foundation Models Cheat Sheet.
  ☆257Updated 4 months ago
• XueFuzhao / OpenMoE
  A family of open-sourced Mixture-of-Experts (MoE) Large Language Models
  ☆1,391Updated 8 months ago
• RLHFlow / RLHF-Reward-Modeling
  Recipes to train reward model for RLHF.
  ☆903Updated this week