Alternatives and similar repositories for bigbird:

Users that are interested in bigbird are comparing it to the libraries listed below

• lucidrains / marge-pytorch
  Implementation of Marge, Pre-training via Paraphrasing, in Pytorch
  ☆75Updated 4 years ago
• jwieting / paraphrastic-representations-at-scale
  ☆75Updated 3 years ago
• martiansideofthemoon / hurdles-longform-qa
  Official repository with code and data accompanying the NAACL 2021 paper "Hurdles to Progress in Long-form Question Answering" (https://a…
  ☆46Updated 2 years ago
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆93Updated 2 years ago
• kwang2049 / easy-elasticsearch
  Using business-level retrieval system (BM25) with Python in just a few lines.
  ☆31Updated 2 years ago
• allenai / EmbeddingRecycling
  Embedding Recycling for Language models
  ☆38Updated last year
• awebson / prompt_semantics
  This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”
  ☆85Updated 2 years ago
• martiansideofthemoon / rankgen
  Official code and model checkpoints for our EMNLP 2022 paper "RankGen - Improving Text Generation with Large Ranking Models" (https://arx…
  ☆136Updated last year
• IBM / model-recycling
  Ranking of fine-tuned HF models as base models.
  ☆35Updated last year
• kamalkraj / BioELECTRA
  BioELECTRA
  ☆51Updated 3 years ago
• google-research-datasets / QED
  QED: A Framework and Dataset for Explanations in Question Answering
  ☆116Updated 3 years ago
• NLPatVCU / multitasking_transformers
  Multitask Learning with Pretrained Transformers
  ☆39Updated 4 years ago
• martiansideofthemoon / relic-retrieval
  Official codebase accompanying our ACL 2022 paper "RELiC: Retrieving Evidence for Literary Claims" (https://relic.cs.umass.edu).
  ☆20Updated 2 years ago
• kaustubhdhole / natural-dont-know
  Code for the paper: Saying No is An Art: Contextualized Fallback Responses for Unanswerable Dialogue Queries
  ☆19Updated 3 years ago
• bigscience-workshop / evaluation
  Code and Data for Evaluation WG
  ☆41Updated 2 years ago
• kayoyin / interpret-lm
  Interpreting Language Models with Contrastive Explanations (EMNLP 2022 Best Paper Honorable Mention)
  ☆62Updated 2 years ago
• oriram / spider
  ☆54Updated 2 years ago
• Yale-LILY / ConvoSumm
  ☆38Updated 2 years ago
• facebookresearch / bart_ls
  Long-context pretrained encoder-decoder models
  ☆94Updated 2 years ago
• ruiqi-zhong / Meta-tuning
  EMNLP 2021 Adapting Language Models for Zero-shot Learning by Meta-tuning on Dataset and Prompt Collections
  ☆50Updated 3 years ago
• gsarti / t5-flax-gcp
  Tutorial to pretrain & fine-tune a 🤗 Flax T5 model on a TPUv3-8 with GCP
  ☆58Updated 2 years ago
• lesterpjy / numeric-t5
  Training T5 to perform numerical reasoning.
  ☆23Updated 3 years ago
• FreddeFrallan / Contrastive-Tension
  State of the art Semantic Sentence Embeddings
  ☆99Updated 2 years ago
• inspired-cognition / critique-apps
  Apps built using Inspired Cognition's Critique.
  ☆58Updated 2 years ago
• Mivg / SLED
  The official repository for Efficient Long-Text Understanding Using Short-Text Models (Ivgi et al., 2022) paper
  ☆70Updated last year
• bvanaken / explain-BERT-QA
  Code for the CIKM 2019 Paper: How Does BERT Answer Questions? A Layer-Wise Analysis of Transformer Representations
  ☆32Updated last year
• g8a9 / ear
  Code associated with the paper "Entropy-based Attention Regularization Frees Unintended Bias Mitigation from Lists"
  ☆48Updated 2 years ago
• gucci-j / light-transformer-emnlp2021
  EMNLP 2021 - Frustratingly Simple Pretraining Alternatives to Masked Language Modeling
  ☆31Updated 3 years ago
• stas00 / porting
  Helper scripts and notes that were used while porting various nlp models
  ☆46Updated 3 years ago
• flipz357 / S3BERT
  Semantically Structured Sentence Embeddings
  ☆65Updated 5 months ago