Alternatives and similar repositories for fermi

Users that are interested in fermi are comparing it to the libraries listed below

• zorazrw / odex
  [EMNLP'23] Execution-Based Evaluation for Open Domain Code Generation
  ☆49Updated 2 years ago
• allenai / Lila
  A unified benchmark for math reasoning
  ☆89Updated 3 years ago
• EleutherAI / semantic-memorization
  ☆44Updated last year
• jlin816 / dialop
  DialOp: Decision-oriented dialogue environments for collaborative language agents
  ☆111Updated last year
• skywalker023 / fantom
  👻 Code and benchmark for our EMNLP 2023 paper - "FANToM: A Benchmark for Stress-testing Machine Theory of Mind in Interactions"
  ☆58Updated last year
• seonghyeonye / Flipped-Learning
  [ICLR 2023] Guess the Instruction! Flipped Learning Makes Language Models Stronger Zero-Shot Learners
  ☆116Updated 7 months ago
• kernelmachine / silo-lm
  SILO Language Models code repository
  ☆83Updated last year
• archiki / GrIPS
  Code for our paper: "GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large Language Models"
  ☆57Updated 2 years ago
• kernelmachine / demix
  DEMix Layers for Modular Language Modeling
  ☆54Updated 4 years ago
• kaistAI / factual-knowledge-acquisition
  ☆24Updated last month
• NohTow / PPL-MCTS
  Repository for the code of the "PPL-MCTS: Constrained Textual Generation Through Discriminator-Guided Decoding" paper, NAACL'22
  ☆66Updated 3 years ago
• aryamanarora / causalgym
  CausalGym: Benchmarking causal interpretability methods on linguistic tasks
  ☆51Updated last year
• XiangLi1999 / AutoBencher
  ☆32Updated last year
• martiansideofthemoon / longeval-summarization
  Official repository for our EACL 2023 paper "LongEval: Guidelines for Human Evaluation of Faithfulness in Long-form Summarization" (https…
  ☆44Updated last year
• cognitiveailab / BYTESIZED32
  Byte-sized text games for code generation tasks on virtual environments
  ☆20Updated last year
• CarperAI / autocrit
  A repository for transformer critique learning and generation
  ☆89Updated 2 years ago
• tau-nlp / scrolls
  The official code of EMNLP 2022, "SCROLLS: Standardized CompaRison Over Long Language Sequences".
  ☆69Updated 2 years ago
• nyu-mll / ILF-for-code-generation
  ☆80Updated 10 months ago
• tianjunz / HIR
  ☆158Updated 2 years ago
• GEM-benchmark / GEM-metrics
  Automatic metrics for GEM tasks
  ☆67Updated 3 years ago
• nkandpa2 / long_tail_knowledge
  Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"
  ☆78Updated 2 years ago
• shayne-longpre / a-pretrainers-guide
  ☆72Updated 2 years ago
• salesforce / factualNLG
  Code for the arXiv paper: "LLMs as Factual Reasoners: Insights from Existing Benchmarks and Beyond"
  ☆61Updated last year
• JunShern / few-shot-adaptation
  Exploring Few-Shot Adaptation of Language Models with Tables
  ☆24Updated 3 years ago
• kernelmachine / demix-data
  Benchmark API for Multidomain Language Modeling
  ☆25Updated 3 years ago
• google-deepmind / emergent_in_context_learning
  ☆86Updated last year
• eladsegal / strategyqa
  The official code of TACL 2021, "Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategies".
  ☆83Updated 3 years ago
• dojoteef / storium-gpt2
  Source code for the GPT-2 story generation models in the EMNLP 2020 paper "STORIUM: A Dataset and Evaluation Platform for Human-in-the-Lo…
  ☆38Updated 2 years ago
• allenai / openpi-dataset
  OpenPI dataset for tracking entities in open domain procedural text
  ☆24Updated last year
• frankxu2004 / knnlm-why
  Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"
  ☆59Updated 3 years ago