Alternatives and similar repositories for catwalk:

Users that are interested in catwalk are comparing it to the libraries listed below

• bigscience-workshop / lm-evaluation-harness
  A framework for few-shot evaluation of autoregressive language models.
  ☆104Updated last year
• facebookresearch / dpr-scale
  Scalable training for dense retrieval models.
  ☆292Updated last month
• google-deepmind / loft
  LOFT: A 1 Million+ Token Long-Context Benchmark
  ☆187Updated 2 weeks ago
• TIGER-AI-Lab / MAmmoTH2
  Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]
  ☆139Updated 5 months ago
• allenai / wimbd
  What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets
  ☆217Updated 5 months ago
• allenai / peS2o
  Pretraining Efficiently on S2ORC!
  ☆160Updated 5 months ago
• nyu-mll / quality
  ☆132Updated 3 months ago
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆126Updated last year
• seonghyeonye / Flipped-Learning
  [ICLR 2023] Guess the Instruction! Flipped Learning Makes Language Models Stronger Zero-Shot Learners
  ☆114Updated 7 months ago
• p-lambda / dsir
  DSIR large-scale data selection framework for language model training
  ☆245Updated last year
• allenai / bff
  ☆38Updated last year
• Edward-Sun / RECITE
  Code of ICLR paper: https://openreview.net/forum?id=-cqvvvb-NkI
  ☆94Updated 2 years ago
• AlexTMallen / adaptive-retrieval
  ☆174Updated 2 years ago
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆196Updated last week
• facebookresearch / Shepherd
  This is the repo for the paper Shepherd -- A Critic for Language Model Generation
  ☆218Updated last year
• tianjunz / HIR
  ☆159Updated 2 years ago
• salesforce / factualNLG
  Code for the arXiv paper: "LLMs as Factual Reasoners: Insights from Existing Benchmarks and Beyond"
  ☆59Updated 2 months ago
• nkandpa2 / long_tail_knowledge
  Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"
  ☆77Updated 2 years ago
• microsoft / HaDes
  Token-level Reference-free Hallucination Detection
  ☆94Updated last year
• google-research / dialog-inpainting
  ☆97Updated 2 years ago
• zetaalphavector / InPars
  Inquisitive Parrots for Search
  ☆189Updated last year
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆77Updated 7 months ago
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆334Updated 6 months ago
• yizhongw / Tk-Instruct
  Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.
  ☆180Updated 2 years ago
• LAION-AI / Open-Instruction-Generalist
  Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks
  ☆208Updated last year
• luyug / Dense
  A toolkit for building dense retrievers with deep language models.
  ☆60Updated 3 years ago
• orionw / FollowIR
  FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions
  ☆42Updated 9 months ago
• jakespringer / echo-embeddings
  ☆145Updated last year
• reasoning-machines / prompt-lib
  A set of utilities for running few-shot prompting experiments on large-language models
  ☆118Updated last year
• kaistAI / CoT-Collection
  [EMNLP 2023] The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning
  ☆238Updated last year