Alternatives and similar repositories for next-level-bert

Users that are interested in next-level-bert are comparing it to the libraries listed below

• allenai / EmbeddingRecycling
  Embedding Recycling for Language models
  ☆38Updated 2 years ago
• ltgoslo / ltg-bert
  LTG-Bert
  ☆34Updated 2 years ago
• JHU-CLSP / ettin-encoder-vs-decoder
  State-of-the-art paired encoder and decoder models (17M-1B params)
  ☆58Updated 5 months ago
• orevaahia / magnet-tokenization
  ☆14Updated last year
• Leukas / CUTE
  ☆19Updated 4 months ago
• konstantinjdobler / focus
  [EMNLP'23] Official Code for "FOCUS: Effective Embedding Initialization for Monolingual Specialization of Multilingual Models"
  ☆36Updated 7 months ago
• bltlab / seqscore
  SeqScore: Scoring for named entity recognition and other sequence labeling tasks
  ☆23Updated last month
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆96Updated 2 years ago
• ielab / Starbucks
  Starbucks: Improved Training for 2D Matryoshka Embeddings
  ☆22Updated 7 months ago
• TristanThrush / perplexity-correlations
  Simple and scalable tools for data-driven pretraining data selection.
  ☆29Updated 7 months ago
• malteos / scincl
  Neighborhood Contrastive Learning for Scientific Document Representations with Citation Embeddings (EMNLP 2022 paper)
  ☆74Updated last month
• coastalcph / hierarchical-transformers
  Hierarchical Attention Transformers (HAT)
  ☆60Updated 2 years ago
• g8a9 / ear
  Code associated with the paper "Entropy-based Attention Regularization Frees Unintended Bias Mitigation from Lists"
  ☆50Updated 3 years ago
• ltgoslo / gpt-bert
  Official implementation of "GPT or BERT: why not both?"
  ☆63Updated 6 months ago
• alon-albalak / FLAD
  Few-shot Learning with Auxiliary Data
  ☆31Updated 2 years ago
• sileod / tasknet
  Easy modernBERT fine-tuning and multi-task learning
  ☆63Updated 7 months ago
• malteos / clp-transfer
  Efficient Language Model Training through Cross-Lingual and Progressive Transfer Learning
  ☆30Updated 3 years ago
• MeLeLBGU / SaGe
  Code for SaGe subword tokenizer (EACL 2023)
  ☆27Updated last year
• catie-aq / flashT5
  A fast implementation of T5/UL2 in PyTorch using Flash Attention
  ☆113Updated 3 months ago
• google-research-datasets / swim-ir
  SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…
  ☆49Updated 2 years ago
• google-research / xtreme-up
  ☆52Updated 2 years ago
• gchhablani / multilingual-vqa
  Repository for Multilingual-VQA task created during HuggingFace JAX/Flax community week.
  ☆34Updated 4 years ago
• thevasudevgupta / bigbird
  Google's BigBird (Jax/Flax & PyTorch) @ 🤗Transformers
  ☆49Updated 2 years ago
• ottowg / gsap-ner
  ☆10Updated last year
• CPJKU / wechsel
  Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.
  ☆87Updated last year
• gucci-j / light-transformer-emnlp2021
  EMNLP 2021 - Frustratingly Simple Pretraining Alternatives to Masked Language Modeling
  ☆34Updated 4 years ago
• jungokasai / beam_with_patience
  ☆46Updated 3 years ago
• ltgoslo / bert-in-context
  Official implementation of "BERTs are Generative In-Context Learners"
  ☆32Updated 10 months ago
• NathanGodey / headless-lm
  Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…
  ☆28Updated last year
• martiansideofthemoon / relic-retrieval
  Official codebase accompanying our ACL 2022 paper "RELiC: Retrieving Evidence for Literary Claims" (https://relic.cs.umass.edu).
  ☆20Updated 3 years ago