Alternatives and similar repositories for catwalk:

Users that are interested in catwalk are comparing it to the libraries listed below

• chaitanyamalaviya / ExpertQA
  [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers
  ☆126Updated last year
• bigscience-workshop / lm-evaluation-harness
  A framework for few-shot evaluation of autoregressive language models.
  ☆103Updated last year
• allenai / wimbd
  What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets
  ☆213Updated 4 months ago
• facebookresearch / dpr-scale
  Scalable training for dense retrieval models.
  ☆284Updated 3 weeks ago
• TIGER-AI-Lab / MAmmoTH2
  Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]
  ☆136Updated 4 months ago
• allenai / bff
  ☆38Updated 11 months ago
• salesforce / factualNLG
  Code for the arXiv paper: "LLMs as Factual Reasoners: Insights from Existing Benchmarks and Beyond"
  ☆59Updated last month
• nyu-mll / quality
  ☆128Updated 2 months ago
• seonghyeonye / Flipped-Learning
  [ICLR 2023] Guess the Instruction! Flipped Learning Makes Language Models Stronger Zero-Shot Learners
  ☆113Updated 6 months ago
• facebookresearch / Shepherd
  This is the repo for the paper Shepherd -- A Critic for Language Model Generation
  ☆218Updated last year
• AlexTMallen / adaptive-retrieval
  ☆174Updated 2 years ago
• p-lambda / dsir
  DSIR large-scale data selection framework for language model training
  ☆244Updated 11 months ago
• WHGTyen / BIG-Bench-Mistake
  A dataset of LLM-generated chain-of-thought steps annotated with mistake location.
  ☆79Updated 7 months ago
• allenai / peS2o
  Pretraining Efficiently on S2ORC!
  ☆158Updated 5 months ago
• IBM / SALMON
  Self-Alignment with Principle-Following Reward Models
  ☆156Updated last year
• SALT-NLP / demonstrated-feedback
  ☆119Updated 5 months ago
• nkandpa2 / long_tail_knowledge
  Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"
  ☆76Updated last year
• kernelmachine / silo-lm
  SILO Language Models code repository
  ☆81Updated last year
• orionw / FollowIR
  FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions
  ☆42Updated 8 months ago
• jakespringer / echo-embeddings
  ☆142Updated 11 months ago
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆196Updated this week
• xlang-ai / BRIGHT
  BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval
  ☆89Updated last month
• LAION-AI / Open-Instruction-Generalist
  Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks
  ☆208Updated last year
• google-deepmind / loft
  LOFT: A 1 Million+ Token Long-Context Benchmark
  ☆180Updated this week
• google-research / dialog-inpainting
  ☆97Updated 2 years ago
• sileod / tasksource
  Datasets collection and preprocessings framework for NLP extreme multitask learning
  ☆175Updated 2 months ago
• veronica320 / Faithful-COT
  Code and data accompanying our paper on arXiv "Faithful Chain-of-Thought Reasoning".
  ☆157Updated 10 months ago
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆218Updated 4 months ago
• sail-sg / sailcraft
  🚢 Data Toolkit for Sailor Language Models
  ☆87Updated 3 weeks ago
• microsoft / HaDes
  Token-level Reference-free Hallucination Detection
  ☆94Updated last year