Alternatives and similar repositories for the-little-retrieval-test:

Users that are interested in the-little-retrieval-test are comparing it to the libraries listed below

• nkandpa2 / long_tail_knowledge
  Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"
  ☆74Updated last year
• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆19Updated 5 months ago
• allenai / OLMo-core
  PyTorch building blocks for OLMo
  ☆49Updated this week
• allenai / bff
  ☆38Updated 9 months ago
• hamishivi / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆64Updated 5 months ago
• hadasah / btm
  ☆72Updated 9 months ago
• swj0419 / in-context-pretraining
  ☆48Updated 9 months ago
• SimengSun / alpaca_farm_lora
  ☆22Updated last year
• ekinakyurek / influence
  Code for "Tracing Knowledge in Language Models Back to the Training Data"
  ☆37Updated 2 years ago
• casmlab / NPHardEval
  Repository for NPHardEval, a quantified-dynamic benchmark of LLMs
  ☆51Updated 10 months ago
• tau-nlp / scrolls
  The official code of EMNLP 2022, "SCROLLS: Standardized CompaRison Over Long Language Sequences".
  ☆70Updated last year
• GSYfate / knnlm-limits
  Official code repo for paper "Great Memory, Shallow Reasoning: Limits of kNN-LMs"
  ☆21Updated 5 months ago
• joeljang / ELM
  [ICML 2023] Exploring the Benefits of Training Expert Language Models over Instruction Tuning
  ☆97Updated last year
• PKU-ML / LongPPL
  ☆27Updated 2 months ago
• frankxu2004 / knnlm-why
  Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"
  ☆56Updated 2 years ago
• suzgunmirac / crowd-sampling
  Follow the Wisdom of the Crowd: Effective Text Generation via Minimum Bayes Risk Decoding
  ☆18Updated 2 years ago
• kernelmachine / demix
  DEMix Layers for Modular Language Modeling
  ☆53Updated 3 years ago
• mega002 / ff-layers
  The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…
  ☆89Updated 3 years ago
• YuxiXie / SelfEval-Guided-Decoding
  ☆93Updated last year
• PrasannS / rlhf-length-biases
  ☆27Updated 10 months ago
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆96Updated 9 months ago
• Shark-NLP / CAB
  ☆30Updated last year
• ndaheim / faithful-dialogue
  ☆23Updated last year
• allenai / easy-to-hard-generalization
  Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"
  ☆46Updated last year
• ars22 / scaling-LLM-math-synthetic-data
  Code and data used in the paper: "Training on Incorrect Synthetic Data via RL Scales LLM Math Reasoning Eight-Fold"
  ☆29Updated 7 months ago
• Leooyii / LCEG
  Long Context Extension and Generalization in LLMs
  ☆40Updated 4 months ago
• google-deepmind / streamingqa
  ☆45Updated last year
• wellecks / lm-evaluation-harness
  A framework for few-shot evaluation of autoregressive language models.
  ☆24Updated last year
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆67Updated 9 months ago
• felixzli / synthetic_pretraining
  ☆39Updated 2 years ago