Alternatives and similar repositories for beaker-gantry

Users that are interested in beaker-gantry are comparing it to the libraries listed below

• tau-nlp / scrolls
  The official code of EMNLP 2022, "SCROLLS: Standardized CompaRison Over Long Language Sequences".
  ☆70Updated last year
• google-deepmind / emergent_in_context_learning
  ☆84Updated 11 months ago
• ruiqi-zhong / DescribeDistributionalDifferences
  Code for preprint: Summarizing Differences between Text Distributions with Natural Language
  ☆42Updated 2 years ago
• kernelmachine / demix
  DEMix Layers for Modular Language Modeling
  ☆53Updated 3 years ago
• McGill-NLP / polytropon
  ☆54Updated 2 years ago
• allenai / beaker-py
  A pure-Python Beaker client
  ☆17Updated this week
• najoungkim / COGS
  ☆61Updated 2 years ago
• belindal / state-probes
  Code for the paper "Implicit Representations of Meaning in Neural Language Models"
  ☆54Updated 2 years ago
• neubig / research-career-tools
  ☆163Updated 7 months ago
• dpfried / pragmatic-instructions
  Pragmatic models for generating and following instructions
  ☆13Updated 5 years ago
• i-machine-think / am-i-compositional
  ☆62Updated 2 years ago
• GEM-benchmark / GEM-metrics
  Automatic metrics for GEM tasks
  ☆66Updated 2 years ago
• vzhong / silg
  ☆20Updated 3 years ago
• lil-lab / kilogram
  The KiloGram Tangrams dataset
  ☆55Updated 2 months ago
• LauraRuis / groundedSCAN
  Grounded SCAN data set.
  ☆69Updated 3 years ago
• INK-USC / CrossFit
  Code for paper "CrossFit : A Few-shot Learning Challenge for Cross-task Generalization in NLP" (https://arxiv.org/abs/2104.08835)
  ☆111Updated 3 years ago
• nouhadziri / faith-and-fate
  ☆34Updated last year
• aryamanarora / causalgym
  CausalGym: Benchmarking causal interpretability methods on linguistic tasks
  ☆44Updated 7 months ago
• brendenlake / SCAN
  Simple language-driven navigation tasks for studying compositional learning
  ☆196Updated 4 years ago
• pcyin / zeroshot_parser
  A zero-shot neural semantic parser without using annotated parallel training data.
  ☆8Updated 3 years ago
• nkandpa2 / long_tail_knowledge
  Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"
  ☆77Updated 2 years ago
• asaparov / prontoqa
  Synthetic question-answering dataset to formally analyze the chain-of-thought output of large language models on a reasoning task.
  ☆146Updated 9 months ago
• tommccoy1 / embers-of-autoregression
  ☆29Updated 6 months ago
• FranxYao / Distributional-Generalization-in-Natural-Language-Processing
  Distributional Generalization in NLP. A roadmap.
  ☆88Updated 2 years ago
• machelreid / m2d2
  M2D2: A Massively Multi-domain Language Modeling Dataset (EMNLP 2022) by Machel Reid, Victor Zhong, Suchin Gururangan, Luke Zettlemoyer
  ☆54Updated 2 years ago
• allenai / openpi-dataset
  OpenPI dataset for tracking entities in open domain procedural text
  ☆24Updated 11 months ago
• cognitiveailab / TextWorldExpress
  Super fast implementations of common benchmark text world games
  ☆50Updated 4 months ago
• jkallini / mission-impossible-language-models
  Code repository for the paper "Mission: Impossible Language Models."
  ☆52Updated 2 months ago
• yoonkim / neural-qcfg
  ☆45Updated 3 years ago
• epfl-dlab / understanding-decoding
  The data and the PyTorch implementation for the models and experiments in the paper "Language Model Decoding as Likelihood–Utility Alignm…
  ☆14Updated last year