Alternatives and similar repositories for beaker-gantry:

Users that are interested in beaker-gantry are comparing it to the libraries listed below

• chaojiang06 / arXivEdits
  Data for EMNLP 2022 paper "arXivEdits: Understanding the Human Revision Process in Scientific Writing".
  ☆14Updated last year
• tau-nlp / scrolls
  The official code of EMNLP 2022, "SCROLLS: Standardized CompaRison Over Long Language Sequences".
  ☆69Updated last year
• allenai / openpi-dataset
  OpenPI dataset for tracking entities in open domain procedural text
  ☆22Updated 6 months ago
• ruiqi-zhong / DescribeDistributionalDifferences
  Code for preprint: Summarizing Differences between Text Distributions with Natural Language
  ☆42Updated last year
• leo-liuzy / probe-across-time
  ☆22Updated 3 years ago
• kernelmachine / demix
  DEMix Layers for Modular Language Modeling
  ☆53Updated 3 years ago
• yoonkim / neural-qcfg
  ☆45Updated 3 years ago
• vzhong / silg
  ☆20Updated 3 years ago
• nkandpa2 / long_tail_knowledge
  Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"
  ☆74Updated last year
• GEM-benchmark / GEM-metrics
  Automatic metrics for GEM tasks
  ☆64Updated 2 years ago
• cpllab / syntactic-generalization
  Code and data for "A Systematic Assessment of Syntactic Generalization in Neural Language Models"
  ☆25Updated 3 years ago
• cognitiveailab / TextWorldExpress
  Super fast implementations of common benchmark text world games
  ☆45Updated 2 months ago
• McGill-NLP / polytropon
  ☆52Updated last year
• suzgunmirac / crowd-sampling
  Follow the Wisdom of the Crowd: Effective Text Generation via Minimum Bayes Risk Decoding
  ☆18Updated 2 years ago
• allenai / numglue
  NumGLUE: A Suite of Fundamental yet Challenging Mathematical Reasoning Tasks
  ☆20Updated 2 years ago
• archiki / ReCEval
  Supporting code for ReCEval paper
  ☆28Updated 5 months ago
• archiki / GrIPS
  Code for our paper: "GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large Language Models"
  ☆53Updated last year
• allenai / natural-instructions-v1
  Benchmarking Generalization to New Tasks from Natural Language Instructions
  ☆26Updated 3 years ago
• peterbhase / LAS-NL-Explanations
  Code for paper "Leakage-Adjusted Simulatability: Can Models Generate Non-Trivial Explanations of Their Behavior in Natural Language?"
  ☆20Updated 4 years ago
• Websail-NU / CODAH
  Repository for the CODAH dataset
  ☆22Updated 2 years ago
• jacobandreas / geca
  ☆42Updated 4 years ago
• ekinakyurek / lexical
  Paper: Lexicon Learning for Few-Shot Neural Sequence Modeling
  ☆15Updated 3 years ago
• najoungkim / COGS
  ☆57Updated 2 years ago
• FranxYao / Distributional-Generalization-in-Natural-Language-Processing
  Distributional Generalization in NLP. A roadmap.
  ☆87Updated 2 years ago
• belindal / state-probes
  Code for the paper "Implicit Representations of Meaning in Neural Language Models"
  ☆50Updated 2 years ago
• peterwestuw / surface-form-competition
  ☆58Updated 2 years ago
• nouhadziri / faith-and-fate
  ☆34Updated 10 months ago
• jiacheng-xu / lattice-generation
  Code for Massive-scale Decoding for Text Generation using Lattices
  ☆45Updated 2 years ago
• jzbjyb / lm-calibration
  ☆33Updated 3 years ago
• violet-zct / swarm-distillation-zero-shot
  ☆22Updated 2 years ago