Alternatives and similar repositories for cut-cross-entropy

Users that are interested in cut-cross-entropy are comparing it to the libraries listed below

• mistralai / mistral-evals
  ☆79Updated 3 weeks ago
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆137Updated 6 months ago
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆78Updated last year
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆45Updated last year
• Danau5tin / calculator_agent_rl
  Training an LLM to use a calculator with multi-turn reinforcement learning, achieving a **62% absolute increase in evaluation accuracy**.
  ☆61Updated 7 months ago
• tyler-romero / microR1
  Simple repository for training small reasoning models
  ☆47Updated 10 months ago
• luyug / magix
  Supercharge huggingface transformers with model parallelism.
  ☆77Updated 4 months ago
• apple / ml-hypercloning
  ☆52Updated last year
• leloykun / modded-nanogpt
  NanoGPT (124M) quality in 2.67B tokens
  ☆28Updated 2 months ago
• Zyphra / Zyda_processing
  ☆39Updated last year
• lucidrains / llama-qrlhf
  Implementation of the Llama architecture with RLHF + Q-learning
  ☆168Updated 10 months ago
• siyan-zhao / prepacking
  The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …
  ☆60Updated last year
• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆80Updated 7 months ago
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆100Updated 9 months ago
• akjindal53244 / Arithmo
  Small and Efficient Mathematical Reasoning LLMs
  ☆72Updated last year
• NousResearch / StripedHyenaTrainer
  ☆62Updated 2 years ago
• Aleph-Alpha-Research / trigrams
  ☆58Updated 3 weeks ago
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆100Updated last year
• lilakk / BLEUBERI
  Official repository for "BLEUBERI: BLEU is a surprisingly effective reward for instruction following"
  ☆31Updated 6 months ago
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆107Updated 9 months ago
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆79Updated last year
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆86Updated last year
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆48Updated last year
• LLM360 / amber-data-prep
  Data preparation code for Amber 7B LLM
  ☆93Updated last year
• hamishivi / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆76Updated last year
• RAIVNLab / AdANNS
  Code repository for the paper - "AdANNS: A Framework for Adaptive Semantic Search"
  ☆65Updated 2 years ago
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆85Updated 7 months ago
• casper-hansen / OpenCoconut
  OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.
  ☆173Updated 10 months ago
• letta-ai / sleep-time-compute
  accompanying material for sleep-time compute paper
  ☆118Updated 7 months ago
• allenai / olmo-cookbook
  OLMost every training recipe you need to perform data interventions with the OLMo family of models.
  ☆57Updated this week