aiintelligentsystems / next-level-bertLinks
☆15Updated last year
Alternatives and similar repositories for next-level-bert
Users that are interested in next-level-bert are comparing it to the libraries listed below
Sorting:
- LTG-Bert☆34Updated last year
- Embedding Recycling for Language models☆38Updated 2 years ago
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.☆96Updated 2 years ago
- State-of-the-art paired encoder and decoder models (17M-1B params)☆53Updated 4 months ago
- ☆15Updated 3 months ago
- Neighborhood Contrastive Learning for Scientific Document Representations with Citation Embeddings (EMNLP 2022 paper)☆74Updated 3 years ago
- Starbucks: Improved Training for 2D Matryoshka Embeddings☆22Updated 5 months ago
- SeqScore: Scoring for named entity recognition and other sequence labeling tasks☆23Updated this week
- Google's BigBird (Jax/Flax & PyTorch) @ 🤗Transformers☆49Updated 2 years ago
- INCOME: An Easy Repository for Training and Evaluation of Index Compression Methods in Dense Retrieval. Includes BPR and JPQ.☆24Updated 2 years ago
- [EMNLP'23] Official Code for "FOCUS: Effective Embedding Initialization for Monolingual Specialization of Multilingual Models"☆34Updated 6 months ago
- Code for SaGe subword tokenizer (EACL 2023)☆27Updated last year
- Easy modernBERT fine-tuning and multi-task learning☆63Updated 5 months ago
- ☆13Updated last year
- Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…☆28Updated last year
- Code for Relevance-guided Supervision for OpenQA with ColBERT (TACL'21)☆40Updated 4 years ago
- Simple and scalable tools for data-driven pretraining data selection.☆29Updated 6 months ago
- Official implementation of "BERTs are Generative In-Context Learners"☆32Updated 9 months ago
- Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.☆85Updated last year
- A fast implementation of T5/UL2 in PyTorch using Flash Attention☆112Updated last month
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆67Updated 2 months ago
- Using business-level retrieval system (BM25) with Python in just a few lines.☆31Updated 2 years ago
- ☆56Updated 2 years ago
- ☆54Updated 2 years ago
- 🔍 Multilingual Evaluation of English-Centric LLMs via Cross-Lingual Alignment☆11Updated 8 months ago
- ☆101Updated 3 years ago
- Official code and model checkpoints for our EMNLP 2022 paper "RankGen - Improving Text Generation with Large Ranking Models" (https://arx…☆138Updated 2 years ago
- EMNLP 2021 - Frustratingly Simple Pretraining Alternatives to Masked Language Modeling☆34Updated 4 years ago
- Code associated with the paper "Entropy-based Attention Regularization Frees Unintended Bias Mitigation from Lists"☆50Updated 3 years ago
- An official repository for MIA 2022 (NAACL 2022 Workshop) Shared Task on Cross-lingual Open-Retrieval Question Answering.☆31Updated 3 years ago