allenai / fm-cheatsheetLinks
Website for hosting the Open Foundation Models Cheat Sheet.
☆269Updated 6 months ago
Alternatives and similar repositories for fm-cheatsheet
Users that are interested in fm-cheatsheet are comparing it to the libraries listed below
Sorting:
- Manage scalable open LLM inference endpoints in Slurm clusters☆277Updated last year
- NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day☆258Updated 2 years ago
- A repository for research on medium sized language models.☆520Updated 5 months ago
- ☆143Updated 2 months ago
- RuLES: a benchmark for evaluating rule-following in language models☆240Updated 9 months ago
- Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"☆315Updated last year
- A puzzle to learn about prompting☆135Updated 2 years ago
- Multipack distributed sampler for fast padding-free training of LLMs☆202Updated last year
- The official evaluation suite and dynamic data release for MixEval.☆253Updated last year
- ModuleFormer is a MoE-based architecture that includes two different types of experts: stick-breaking attention heads and feedforward exp…☆225Updated 2 months ago
- Scaling Data-Constrained Language Models☆342Updated 5 months ago
- code for training & evaluating Contextual Document Embedding models☆201Updated 6 months ago
- A comprehensive deep dive into the world of tokens☆227Updated last year
- Fast & more realistic evaluation of chat language models. Includes leaderboard.☆189Updated last year
- batched loras☆347Updated 2 years ago
- Let's build better datasets, together!☆265Updated 11 months ago
- Extract full next-token probabilities via language model APIs☆248Updated last year
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆174Updated 5 months ago
- Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)☆194Updated last year
- BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.☆219Updated 3 months ago
- git extension for {collaborative, communal, continual} model development☆216Updated last year
- ☆556Updated last year
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".☆220Updated last month
- Understand and test language model architectures on synthetic tasks.☆240Updated 2 months ago
- ☆138Updated 3 months ago
- Scaling is a distributed training library and installable dependency designed to scale up neural networks, with a dedicated module for tr…☆66Updated 2 weeks ago
- ☆270Updated 10 months ago
- ☆257Updated 8 months ago
- Toolkit for attaching, training, saving and loading of new heads for transformer models☆292Updated 8 months ago
- nanoGPT-like codebase for LLM training☆111Updated 3 weeks ago