Alternatives and similar repositories for next-level-bert

Users that are interested in next-level-bert are comparing it to the libraries listed below

• ltgoslo / ltg-bert
  LTG-Bert
  ☆33Updated last year
• allenai / EmbeddingRecycling
  Embedding Recycling for Language models
  ☆39Updated 2 years ago
• Leukas / CUTE
  ☆14Updated 3 months ago
• JHU-CLSP / ettin-encoder-vs-decoder
  State-of-the-art paired encoder and decoder models (17M-1B params)
  ☆44Updated 3 weeks ago
• thevasudevgupta / bigbird
  Google's BigBird (Jax/Flax & PyTorch) @ 🤗Transformers
  ☆49Updated 2 years ago
• sileod / tasknet
  Easy modernBERT fine-tuning and multi-task learning
  ☆61Updated last month
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆93Updated 2 years ago
• konstantinjdobler / focus
  [EMNLP'23] Official Code for "FOCUS: Effective Embedding Initialization for Monolingual Specialization of Multilingual Models"
  ☆33Updated 2 months ago
• thakur-nandan / income
  INCOME: An Easy Repository for Training and Evaluation of Index Compression Methods in Dense Retrieval. Includes BPR and JPQ.
  ☆24Updated last year
• ielab / Starbucks
  Starbucks: Improved Training for 2D Matryoshka Embeddings
  ☆21Updated 2 months ago
• malteos / scincl
  Neighborhood Contrastive Learning for Scientific Document Representations with Citation Embeddings (EMNLP 2022 paper)
  ☆71Updated 2 years ago
• MeLeLBGU / SaGe
  Code for SaGe subword tokenizer (EACL 2023)
  ☆26Updated 9 months ago
• zouharvi / tokenization-scorer
  Simple-to-use scoring function for arbitrarily tokenized texts.
  ☆46Updated 6 months ago
• malteos / clp-transfer
  Efficient Language Model Training through Cross-Lingual and Progressive Transfer Learning
  ☆30Updated 2 years ago
• Knowledgator / FlashDeBERTa
  Trully flash implementation of DeBERTa disentangled attention mechanism.
  ☆63Updated 3 weeks ago
• g8a9 / ear
  Code associated with the paper "Entropy-based Attention Regularization Frees Unintended Bias Mitigation from Lists"
  ☆49Updated 3 years ago
• coastalcph / hierarchical-transformers
  Hierarchical Attention Transformers (HAT)
  ☆58Updated last year
• CPJKU / wechsel
  Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.
  ☆83Updated 11 months ago
• bltlab / seqscore
  SeqScore: Scoring for named entity recognition and other sequence labeling tasks
  ☆23Updated 5 months ago
• guy-dar / embedding-space
  ☆53Updated 2 years ago
• alon-albalak / FLAD
  Few-shot Learning with Auxiliary Data
  ☆31Updated last year
• mia-workshop / MIA-Shared-Task-2022
  An official repository for MIA 2022 (NAACL 2022 Workshop) Shared Task on Cross-lingual Open-Retrieval Question Answering.
  ☆31Updated 3 years ago
• allenai / peS2o
  Pretraining Efficiently on S2ORC!
  ☆166Updated 10 months ago
• google-research-datasets / swim-ir
  SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…
  ☆49Updated last year
• gchhablani / multilingual-vqa
  Repository for Multilingual-VQA task created during HuggingFace JAX/Flax community week.
  ☆34Updated 4 years ago
• IBM / model-recycling
  Ranking of fine-tuned HF models as base models.
  ☆36Updated 3 months ago
• ltgoslo / gpt-bert
  Official implementation of "GPT or BERT: why not both?"
  ☆57Updated last month
• ltgoslo / bert-in-context
  Official implementation of "BERTs are Generative In-Context Learners"
  ☆32Updated 5 months ago
• catie-aq / flashT5
  A fast implementation of T5/UL2 in PyTorch using Flash Attention
  ☆107Updated 5 months ago
• NathanGodey / headless-lm
  Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…
  ☆27Updated last year