ccdv-ai / convert_checkpoint_to_lsg
Efficient Attention for Long Sequence Processing
☆89Updated 11 months ago
Related projects ⓘ
Alternatives and complementary repositories for convert_checkpoint_to_lsg
- A multilingual version of MS MARCO passage ranking dataset☆142Updated last year
- This repository contains the code for "Generating Datasets with Pretrained Language Models".☆187Updated 3 years ago
- [NAACL 2021] This is the code for our paper `Fine-Tuning Pre-trained Language Model with Weak Supervision: A Contrastive-Regularized Self…☆201Updated 2 years ago
- [EMNLP 2021] Improving and Simplifying Pattern Exploiting Training☆153Updated 2 years ago
- ☆42Updated 2 years ago
- Inquisitive Parrots for Search☆178Updated 8 months ago
- Mr. TyDi is a multi-lingual benchmark dataset built on TyDi, covering eleven typologically diverse languages.☆72Updated 2 years ago
- The official code for PRIMERA: Pyramid-based Masked Sentence Pre-training for Multi-document Summarization☆153Updated 2 years ago
- ☆16Updated last year
- Powerful unsupervised domain adaptation method for dense retrieval. Requires only unlabeled corpus and yields massive improvement: "GPL: …☆323Updated last year
- XtremeDistil framework for distilling/compressing massive multilingual neural network models to tiny and efficient models for AI at scale☆153Updated 11 months ago
- Search Engines with Autoregressive Language models☆277Updated last year
- Collection of NLP model explanations and accompanying analysis tools☆145Updated last year
- Neural information retrieval / Semantic search / Bi-encoders☆167Updated last year
- Master thesis with code investigating methods for incorporating long-context reasoning in low-resource languages, without the need to pre…☆32Updated 3 years ago
- pyTorch implementation of Recurrence over BERT (RoBERT) based on this paper https://arxiv.org/abs/1910.10781 and comparison with pyTorch …☆79Updated 2 years ago
- A repo to explore different NLP tasks which can be solved using T5☆169Updated 3 years ago
- This repository contains materials for the SIGIR 2022 tutorial on opinion summarization.☆34Updated 2 years ago
- A Multilingual Replicable Instruction-Following Model☆94Updated last year
- ☆179Updated last year
- Dense hybrid representations for text retrieval☆62Updated last year
- Long Document Summarization Papers☆136Updated last year
- The autoregressive information extraction system GenIE (Generative Information Extraction) implemented in PyTorch.☆99Updated last year
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.☆92Updated last year
- On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselines☆132Updated last year
- Google's BigBird (Jax/Flax & PyTorch) @ 🤗Transformers☆47Updated last year
- A library to conduct ranking experiments with transformers.☆161Updated last year
- Some notebooks for NLP☆188Updated last year
- Few-Shot-Intent-Detection includes popular challenging intent detection datasets with/without OOS queries and state-of-the-art baselines …☆133Updated last year
- PyTorch – SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models.☆59Updated 2 years ago