Alternatives and similar repositories for bigbird

Users that are interested in bigbird are comparing it to the libraries listed below

• lucidrains / marge-pytorch
  Implementation of Marge, Pre-training via Paraphrasing, in Pytorch
  ☆76Updated 4 years ago
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆93Updated 2 years ago
• jwieting / paraphrastic-representations-at-scale
  ☆76Updated 3 years ago
• martiansideofthemoon / hurdles-longform-qa
  Official repository with code and data accompanying the NAACL 2021 paper "Hurdles to Progress in Long-form Question Answering" (https://a…
  ☆46Updated 2 years ago
• kayoyin / interpret-lm
  Interpreting Language Models with Contrastive Explanations (EMNLP 2022 Best Paper Honorable Mention)
  ☆62Updated 3 years ago
• bigscience-workshop / evaluation
  Code and Data for Evaluation WG
  ☆41Updated 3 years ago
• martiansideofthemoon / rankgen
  Official code and model checkpoints for our EMNLP 2022 paper "RankGen - Improving Text Generation with Large Ranking Models" (https://arx…
  ☆136Updated last year
• lesterpjy / numeric-t5
  Training T5 to perform numerical reasoning.
  ☆24Updated 4 years ago
• martiansideofthemoon / relic-retrieval
  Official codebase accompanying our ACL 2022 paper "RELiC: Retrieving Evidence for Literary Claims" (https://relic.cs.umass.edu).
  ☆20Updated 3 years ago
• gsarti / t5-flax-gcp
  Tutorial to pretrain & fine-tune a 🤗 Flax T5 model on a TPUv3-8 with GCP
  ☆58Updated 2 years ago
• kwang2049 / easy-elasticsearch
  Using business-level retrieval system (BM25) with Python in just a few lines.
  ☆31Updated 2 years ago
• awebson / prompt_semantics
  This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”
  ☆85Updated 3 years ago
• IBM / model-recycling
  Ranking of fine-tuned HF models as base models.
  ☆35Updated last month
• allenai / EmbeddingRecycling
  Embedding Recycling for Language models
  ☆38Updated last year
• google-research-datasets / QED
  QED: A Framework and Dataset for Explanations in Question Answering
  ☆116Updated 3 years ago
• salesforce / DocNLI
  ☆68Updated last month
• oriram / spider
  ☆54Updated 2 years ago
• lucidrains / coco-lm-pytorch
  Implementation of COCO-LM, Correcting and Contrasting Text Sequences for Language Model Pretraining, in Pytorch
  ☆46Updated 4 years ago
• kaustubhdhole / natural-dont-know
  Code for the paper: Saying No is An Art: Contextualized Fallback Responses for Unanswerable Dialogue Queries
  ☆19Updated 3 years ago
• NLPatVCU / multitasking_transformers
  Multitask Learning with Pretrained Transformers
  ☆40Updated 4 years ago
• Yale-LILY / ConvoSumm
  ☆38Updated 2 years ago
• nreimers / se-pytorch-xla
  ☆21Updated 3 years ago
• ntunlp / Zero-Shot-Cross-Lingual-NER
  A repository for our AAAI-2020 Cross-lingual-NER paper. Code will be updated shortly.
  ☆47Updated 2 years ago
• gucci-j / light-transformer-emnlp2021
  EMNLP 2021 - Frustratingly Simple Pretraining Alternatives to Masked Language Modeling
  ☆31Updated 3 years ago
• tuvuumass / task-transferability
  Data and code for our paper "Exploring and Predicting Transferability across NLP Tasks", to appear at EMNLP 2020.
  ☆50Updated 4 years ago
• shmsw25 / bart-closed-book-qa
  A BART version of an open-domain QA model in a closed-book setup
  ☆119Updated 4 years ago
• kamalkraj / BioELECTRA
  BioELECTRA
  ☆50Updated 3 years ago
• microsoft / GLUECoS
  A benchmark for code-switched NLP, ACL 2020
  ☆75Updated last year
• mayhewsw / multilingual-t5
  ☆12Updated 4 years ago
• esdurmus / Wikilingua
  Multilingual abstractive summarization dataset extracted from WikiHow.
  ☆92Updated 3 months ago