Alternatives and similar repositories for accelerate_tricks

Users that are interested in accelerate_tricks are comparing it to the libraries listed below

• princeton-nlp / ProLong
  Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"
  ☆246Updated 4 months ago
• princeton-nlp / HELMET
  The HELMET Benchmark
  ☆198Updated 2 months ago
• nightdessert / Retrieval_Head
  open-source code for paper: Retrieval Head Mechanistically Explains Long-Context Factuality
  ☆229Updated last year
• FranxYao / Long-Context-Data-Engineering
  Implementation of paper Data Engineering for Scaling Language Models to 128K Context
  ☆484Updated last year
• astramind-ai / Mixture-of-depths
  Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆177Updated last year
• lucidrains / speculative-decoding
  Explorations into some recent techniques surrounding speculative decoding
  ☆299Updated last year
• Cohere-Labs-Community / parameter-efficient-moe
  ☆273Updated 2 years ago
• da03 / Internalize_CoT_Step_by_Step
  ☆203Updated 9 months ago
• CASE-Lab-UMD / LLM-Drop
  The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".
  ☆188Updated 2 months ago
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆337Updated 2 weeks ago
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆255Updated last year
• CodeCreator / WebOrganizer
  Organize the Web: Constructing Domains Enhances Pre-Training Data Curation
  ☆77Updated 9 months ago
• booydar / babilong
  BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.
  ☆238Updated 5 months ago
• p-lambda / dsir
  DSIR large-scale data selection framework for language model training
  ☆269Updated last year
• microsoft / rho
  Repo for Rho-1: Token-level Data Selection & Selective Pretraining of LLMs.
  ☆456Updated last year
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆246Updated last year
• lucidrains / coconut-pytorch
  Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch
  ☆182Updated 7 months ago
• TIGER-AI-Lab / LongICLBench
  Code and Data for "Long-context LLMs Struggle with Long In-context Learning" [TMLR2025]
  ☆111Updated 11 months ago
• mengxiayu / LLMSuperWeight
  Code for studying the super weight in LLM
  ☆121Updated last year
• huggingface / picotron_tutorial
  ☆232Updated 2 months ago
• prateeky2806 / ties-merging
  ☆209Updated 2 years ago
• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆261Updated 9 months ago
• imoneoi / multipack
  Multipack distributed sampler for fast padding-free training of LLMs
  ☆204Updated last year
• zankner / CLoud
  Critique-out-Loud Reward Models
  ☆73Updated last year
• TIGER-AI-Lab / General-Reasoner
  General Reasoner: Advancing LLM Reasoning Across All Domains [NeurIPS25]
  ☆216Updated 2 months ago
• haonan3 / AnchorContext
  AnchorAttention: Improved attention for LLMs long-context training
  ☆213Updated last year
• yihedeng9 / rlhf-summary-notes
  A brief and partial summary of RLHF algorithms.
  ☆144Updated 11 months ago
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆224Updated last month
• da03 / implicit_chain_of_thought
  ☆140Updated last year
• llm-merging / LLM-Merging
  LLM-Merging: Building LLMs Efficiently through Merging
  ☆209Updated last year