Alternatives and similar repositories for catwalk:

Users that are interested in catwalk are comparing it to the libraries listed below

• bigscience-workshop / lm-evaluation-harness
  A framework for few-shot evaluation of autoregressive language models.
  ☆103Updated last year
• allenai / wimbd
  What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets
  ☆211Updated 3 months ago
• allenai / peS2o
  Pretraining Efficiently on S2ORC!
  ☆156Updated 4 months ago
• facebookresearch / dpr-scale
  Scalable training for dense retrieval models.
  ☆282Updated 2 weeks ago
• nyu-mll / quality
  ☆127Updated last month
• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆125Updated 11 months ago
• allenai / bff
  ☆38Updated 10 months ago
• p-lambda / dsir
  DSIR large-scale data selection framework for language model training
  ☆242Updated 11 months ago
• seonghyeonye / TAPP
  [AAAI 2024] Investigating the Effectiveness of Task-Agnostic Prefix Prompt for Instruction Following
  ☆79Updated 5 months ago
• TIGER-AI-Lab / MAmmoTH2
  Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]
  ☆136Updated 4 months ago
• google-deepmind / loft
  LOFT: A 1 Million+ Token Long-Context Benchmark
  ☆176Updated last week
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆334Updated 5 months ago
• kernelmachine / silo-lm
  SILO Language Models code repository
  ☆81Updated last year
• shayne-longpre / a-pretrainers-guide
  ☆72Updated last year
• hadasah / btm
  ☆73Updated 10 months ago
• nkandpa2 / long_tail_knowledge
  Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"
  ☆75Updated last year
• allenai / OLMo-core
  PyTorch building blocks for the OLMo ecosystem
  ☆71Updated this week
• IBM / SALMON
  Self-Alignment with Principle-Following Reward Models
  ☆156Updated last year
• salesforce / factualNLG
  Code for the arXiv paper: "LLMs as Factual Reasoners: Insights from Existing Benchmarks and Beyond"
  ☆59Updated last month
• seonghyeonye / Flipped-Learning
  [ICLR 2023] Guess the Instruction! Flipped Learning Makes Language Models Stronger Zero-Shot Learners
  ☆113Updated 5 months ago
• yizhongw / Tk-Instruct
  Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.
  ☆179Updated 2 years ago
• Edward-Sun / RECITE
  Code of ICLR paper: https://openreview.net/forum?id=-cqvvvb-NkI
  ☆94Updated 2 years ago
• google-research / dialog-inpainting
  ☆97Updated 2 years ago
• google-research / true
  Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".
  ☆75Updated 3 months ago
• facebookresearch / tart
  Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.
  ☆161Updated last year
• tau-nlp / scrolls
  The official code of EMNLP 2022, "SCROLLS: Standardized CompaRison Over Long Language Sequences".
  ☆69Updated last year
• google-deepmind / streamingqa
  ☆45Updated last year
• mbzuai-nlp / bactrian-x
  A Multilingual Replicable Instruction-Following Model
  ☆93Updated last year
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆218Updated 4 months ago
• zetaalphavector / InPars
  Inquisitive Parrots for Search
  ☆188Updated last year