allenai / fm-cheatsheet

Related projects: ⓘ

• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆217Updated 2 months ago
• llm-efficiency-challenge / neurips_llm_efficiency_challenge
  NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
  ☆248Updated 10 months ago
• Psycoy / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆200Updated this week
• mlfoundations / open_lm
  A repository for research on medium sized language models.
  ☆469Updated last month
• huggingface / cosmopedia
  ☆419Updated 2 months ago
• lm-sys / llm-decontaminator
  Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"
  ☆264Updated 8 months ago
• huggingface / lighteval
  LightEval is a lightweight LLM evaluation suite that Hugging Face has been using internally with the recently released LLM data processin…
  ☆667Updated this week
• imoneoi / multipack_sampler
  Multipack distributed sampler for fast padding-free training of LLMs
  ☆170Updated last month
• KellerJordan / modded-nanogpt
  GPT-2 (124M) quality in 5B tokens
  ☆227Updated last week
• SumanthRH / tokenization
  A comprehensive deep dive into the world of tokens
  ☆212Updated 2 months ago
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆213Updated last week
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆310Updated this week
• normster / llm_rules
  RuLES: a benchmark for evaluating rule-following in language models
  ☆209Updated this week
• IBM / ModuleFormer
  ModuleFormer is a MoE-based architecture that includes two different types of experts: stick-breaking attention heads and feedforward exp…
  ☆218Updated 5 months ago
• allenai / reward-bench
  RewardBench: the first evaluation tool for reward models.
  ☆352Updated last week
• justinchiu / openlogprobs
  Extract full next-token probabilities via language model APIs
  ☆226Updated 6 months ago
• NVIDIA / NeMo-Curator
  Scalable data pre processing and curation toolkit for LLMs
  ☆461Updated this week
• arcee-ai / DistillKit
  An Open Source Toolkit For LLM Distillation
  ☆284Updated last month
• sabetAI / BLoRA
  batched loras
  ☆327Updated last year
• magicproduct / hash-hop
  Long context evaluation for large language models
  ☆148Updated this week
• srush / GPTWorld
  A puzzle to learn about prompting
  ☆106Updated last year
• gautierdag / bpeasy
  Fast bare-bones BPE for modern tokenizer training
  ☆138Updated 3 weeks ago
• stanford-crfm / levanter
  Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax
  ☆493Updated this week
• huggingface / nanotron
  Minimalistic large language model 3D-parallelism training
  ☆1,116Updated this week
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆195Updated last month
• EleutherAI / sae
  Sparse autoencoders
  ☆297Updated last week
• booydar / babilong
  BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.
  ☆139Updated 3 weeks ago
• SkunkworksAI / hydra-moe
  ☆409Updated 10 months ago
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆89Updated last week