allenai / fm-cheatsheet
Website for hosting the Open Foundation Models Cheat Sheet.
☆264Updated last week
Alternatives and similar repositories for fm-cheatsheet:
Users that are interested in fm-cheatsheet are comparing it to the libraries listed below
- Manage scalable open LLM inference endpoints in Slurm clusters☆253Updated 8 months ago
- NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day☆255Updated last year
- Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"☆298Updated last year
- A puzzle to learn about prompting☆124Updated last year
- A repository for research on medium sized language models.☆493Updated 2 months ago
- Extract full next-token probabilities via language model APIs☆233Updated last year
- Scaling Data-Constrained Language Models☆333Updated 6 months ago
- RuLES: a benchmark for evaluating rule-following in language models☆220Updated 3 weeks ago
- Multipack distributed sampler for fast padding-free training of LLMs☆186Updated 7 months ago
- batched loras☆340Updated last year
- The official evaluation suite and dynamic data release for MixEval.☆233Updated 4 months ago
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆189Updated 3 months ago
- Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'☆186Updated 3 months ago
- ☆124Updated this week
- ☆501Updated 4 months ago
- ModuleFormer is a MoE-based architecture that includes two different types of experts: stick-breaking attention heads and feedforward exp…☆217Updated 11 months ago
- BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.☆194Updated 3 weeks ago
- PyTorch building blocks for the OLMo ecosystem☆165Updated this week
- A MAD laboratory to improve AI architecture designs 🧪☆108Updated 3 months ago
- Inference code for Persimmon-8B☆415Updated last year
- ☆92Updated last year
- Implementation of paper Data Engineering for Scaling Language Models to 128K Context☆453Updated last year
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".☆194Updated this week
- A comprehensive deep dive into the world of tokens☆221Updated 8 months ago
- awesome synthetic (text) datasets☆264Updated 4 months ago
- Just a bunch of benchmark logs for different LLMs☆119Updated 7 months ago
- ☆113Updated 5 months ago
- nanoGPT-like codebase for LLM training☆91Updated this week
- ☆158Updated last month
- LOFT: A 1 Million+ Token Long-Context Benchmark☆180Updated this week