ccdv-ai / convert_checkpoint_to_lsg
Efficient Attention for Long Sequence Processing
☆92Updated last year
Alternatives and similar repositories for convert_checkpoint_to_lsg:
Users that are interested in convert_checkpoint_to_lsg are comparing it to the libraries listed below
- A multilingual version of MS MARCO passage ranking dataset☆143Updated last year
- A repo to explore different NLP tasks which can be solved using T5☆171Updated 4 years ago
- This repository contains the code for "Generating Datasets with Pretrained Language Models".☆188Updated 3 years ago
- pyTorch implementation of Recurrence over BERT (RoBERT) based on this paper https://arxiv.org/abs/1910.10781 and comparison with pyTorch …☆80Updated 2 years ago
- [EMNLP 2021] Improving and Simplifying Pattern Exploiting Training☆154Updated 2 years ago
- Powerful unsupervised domain adaptation method for dense retrieval. Requires only unlabeled corpus and yields massive improvement: "GPL: …☆329Updated last year
- Some notebooks for NLP☆196Updated last year
- [NAACL 2021] This is the code for our paper `Fine-Tuning Pre-trained Language Model with Weak Supervision: A Contrastive-Regularized Self…☆201Updated 2 years ago
- Resources for the "Evaluating the Factual Consistency of Abstractive Text Summarization" paper☆292Updated last year
- ☆182Updated last year
- Collection of NLP model explanations and accompanying analysis tools☆145Updated last year
- XtremeDistil framework for distilling/compressing massive multilingual neural network models to tiny and efficient models for AI at scale☆153Updated last year
- BARTScore: Evaluating Generated Text as Text Generation☆344Updated 2 years ago
- Neural information retrieval / Semantic search / Bi-encoders☆168Updated last year
- On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselines☆135Updated last year
- DialogSum: A Real-life Scenario Dialogue Summarization Dataset - Findings of ACL 2021☆176Updated 3 months ago
- This dataset contains synthetic training data for grammatical error correction. The corpus is generated by corrupting clean sentences fro…☆160Updated 5 months ago
- A library to conduct ranking experiments with transformers.☆161Updated last year
- A Natural Language Inference (NLI) model based on Transformers (BERT and ALBERT)☆132Updated last year
- State of the art Semantic Sentence Embeddings☆99Updated 2 years ago
- A Multilingual Replicable Instruction-Following Model☆93Updated last year
- a gaggle of deep neural architectures for text ranking and question answering, designed for Pyserini☆348Updated last year
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.☆93Updated 2 years ago
- ☆102Updated 3 years ago
- ☆16Updated 2 years ago
- This repository contains materials for the SIGIR 2022 tutorial on opinion summarization.☆34Updated 2 years ago
- ☆57Updated 2 years ago
- Pretrain and finetune ELECTRA with fastai and huggingface. (Results of the paper replicated !)☆327Updated last year
- The official code for PRIMERA: Pyramid-based Masked Sentence Pre-training for Multi-document Summarization☆157Updated 2 years ago
- Long Document Summarization Papers☆145Updated last year