allenai / fm-cheatsheetView external linksLinks
Website for hosting the Open Foundation Models Cheat Sheet.
☆269May 7, 2025Updated 9 months ago
Alternatives and similar repositories for fm-cheatsheet
Users that are interested in fm-cheatsheet are comparing it to the libraries listed below
Sorting:
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.☆2,885Updated this week
- RewardBench: the first evaluation tool for reward models.☆687Jan 31, 2026Updated 2 weeks ago
- Data and tools for generating and inspecting OLMo pre-training data.☆1,404Nov 5, 2025Updated 3 months ago
- ☆19Mar 16, 2025Updated 10 months ago
- Supercharge huggingface transformers with model parallelism.☆78Jul 23, 2025Updated 6 months ago
- Minimalistic large language model 3D-parallelism training☆2,544Dec 11, 2025Updated 2 months ago
- Tools for merging pretrained large language models.☆6,783Jan 26, 2026Updated 2 weeks ago
- some common Huggingface transformers in maximal update parametrization (µP)☆87Mar 14, 2022Updated 3 years ago
- Robust recipes to align language models with human and AI preferences☆5,495Sep 8, 2025Updated 5 months ago
- Deep Learning for Video Retrieval by Natural Language☆11Oct 20, 2019Updated 6 years ago
- The backend behind the LLM-Perf Leaderboard☆11May 5, 2024Updated last year
- Deep learning for dummies. All the practical details and useful utilities that go into working with real models.☆828Jul 29, 2025Updated 6 months ago
- Tooling for exact and MinHash deduplication of large-scale text datasets☆68Feb 4, 2026Updated last week
- Memory optimization and training recipes to extrapolate language models' context length to 1 million tokens, with minimal hardware.☆752Sep 27, 2024Updated last year
- Simple and efficient pytorch-native transformer training and inference (batched)☆79Apr 2, 2024Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆267Dec 4, 2025Updated 2 months ago
- Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"☆316Dec 20, 2023Updated 2 years ago
- Evaluation suite for LLMs☆378Jul 11, 2025Updated 7 months ago
- ☆97Jan 24, 2026Updated 3 weeks ago
- Language models scale reliably with over-training and on downstream tasks☆99Apr 2, 2024Updated last year
- [ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding☆1,316Mar 6, 2025Updated 11 months ago
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆2,293Jan 21, 2026Updated 3 weeks ago
- ☆169May 27, 2024Updated last year
- This project shows how to derive the total number of training tokens from a large text dataset from 🤗 datasets with Apache Beam and Data…☆27Oct 20, 2022Updated 3 years ago
- Scalable data pre processing and curation toolkit for LLMs☆1,402Updated this week
- A family of open-sourced Mixture-of-Experts (MoE) Large Language Models☆1,657Mar 8, 2024Updated last year
- Go ahead and axolotl questions☆11,289Updated this week
- A pipeline parallel training script for LLMs.☆166Apr 30, 2025Updated 9 months ago
- [NeurlPS D&B 2024] Generative AI for Math: MathPile☆419Apr 4, 2025Updated 10 months ago
- Benchmarking LLMs with Challenging Tasks from Real Users☆246Nov 3, 2024Updated last year
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆693Jan 26, 2026Updated 2 weeks ago
- Open sourced backend for Martian's LLM Inference Provider Leaderboard☆21Aug 13, 2024Updated last year
- PyTorch native post-training library☆5,669Updated this week
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".☆224Dec 16, 2025Updated last month
- CUDA and Triton implementations of Flash Attention with SoftmaxN.☆73May 26, 2024Updated last year
- ☆316Jun 21, 2024Updated last year
- Evolution Through Large Models☆737Nov 15, 2023Updated 2 years ago
- Extract full next-token probabilities via language model APIs☆248Feb 23, 2024Updated last year
- ☆50Mar 14, 2024Updated last year