srush / awesome-o1

Related projects ⓘ

Alternatives and complementary repositories for awesome-o1

• allenai / reward-bench
  RewardBench: the first evaluation tool for reward models.
  ☆426Updated 2 weeks ago
• ContextualAI / HALOs
  A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).
  ☆739Updated last week
• ruizheliUOA / Awesome-Interpretability-in-Large-Language-Models
  This repository collects all relevant resources about interpretability in LLMs
  ☆283Updated last week
• open-thought / system-2-research
  System 2 Reasoning Link Collection
  ☆686Updated 2 weeks ago
• jzhang38 / EasyContext
  Memory optimization and training recipes to extrapolate language models' context length to 1 million tokens, with minimal hardware.
  ☆644Updated last month
• srush / LLM-Training-Puzzles
  What would you do with 1000 H100s...
  ☆895Updated 10 months ago
• huggingface / nanotron
  Minimalistic large language model 3D-parallelism training
  ☆1,229Updated last week
• HazyResearch / aisys-building-blocks
  Building blocks for foundation models.
  ☆388Updated 10 months ago
• allenai / open-instruct
  ☆1,263Updated this week
• stanfordnlp / pyvene
  Stanford NLP Python Library for Understanding and Improving PyTorch Models via Interventions
  ☆633Updated this week
• srush / annotated-mamba
  Annotated version of the Mamba paper
  ☆455Updated 8 months ago
• maitrix-org / llm-reasoners
  A library for advanced large language model reasoning
  ☆1,420Updated 2 months ago
• trotsky1997 / MathBlackBox
  ☆920Updated this week
• jbloomAus / SAELens
  Training Sparse Autoencoders on Language Models
  ☆448Updated this week
• openai / sparse_autoencoder
  ☆320Updated 3 months ago
• NVIDIA / NeMo-Aligner
  Scalable toolkit for efficient model alignment
  ☆614Updated this week
• andyzoujm / representation-engineering
  Representation Engineering: A Top-Down Approach to AI Transparency
  ☆721Updated 2 months ago
• EleutherAI / sae
  Sparse autoencoders
  ☆336Updated 3 weeks ago
• haoliuhl / ringattention
  Transformers with Arbitrarily Large Context
  ☆637Updated 3 months ago
• EleutherAI / cookbook
  Deep learning for dummies. All the practical details and useful utilities that go into working with real models.
  ☆711Updated last month
• allenai / fm-cheatsheet
  Website for hosting the Open Foundation Models Cheat Sheet.
  ☆255Updated 4 months ago
• FranxYao / Long-Context-Data-Engineering
  Implementation of paper Data Engineering for Scaling Language Models to 128K Context
  ☆435Updated 7 months ago
• xfactlab / orpo
  Official repository for ORPO
  ☆419Updated 5 months ago
• tatsu-lab / gpt_paper_assistant
  GPT4 based personalized ArXiv paper assistant bot
  ☆487Updated 7 months ago
• princeton-nlp / SimPO
  [NeurIPS 2024] SimPO: Simple Preference Optimization with a Reference-Free Reward
  ☆704Updated last week
• huggingface / lighteval
  Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
  ☆788Updated this week
• mlfoundations / open_lm
  A repository for research on medium sized language models.
  ☆479Updated last week
• princeton-nlp / LLM-Shearing
  [ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
  ☆553Updated 8 months ago
• microsoft / Samba
  Official implementation of "Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling"
  ☆801Updated 2 months ago