Alternatives and similar repositories for next-level-bert

Users that are interested in next-level-bert are comparing it to the libraries listed below

• allenai / EmbeddingRecycling
  Embedding Recycling for Language models
  ☆38Updated 2 years ago
• Leukas / CUTE
  ☆15Updated 2 months ago
• JHU-CLSP / ettin-encoder-vs-decoder
  State-of-the-art paired encoder and decoder models (17M-1B params)
  ☆53Updated 3 months ago
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆96Updated 2 years ago
• ltgoslo / ltg-bert
  LTG-Bert
  ☆34Updated last year
• konstantinjdobler / focus
  [EMNLP'23] Official Code for "FOCUS: Effective Embedding Initialization for Monolingual Specialization of Multilingual Models"
  ☆34Updated 5 months ago
• TristanThrush / perplexity-correlations
  Simple and scalable tools for data-driven pretraining data selection.
  ☆29Updated 5 months ago
• ielab / Starbucks
  Starbucks: Improved Training for 2D Matryoshka Embeddings
  ☆22Updated 5 months ago
• MeLeLBGU / SaGe
  Code for SaGe subword tokenizer (EACL 2023)
  ☆27Updated last year
• thevasudevgupta / bigbird
  Google's BigBird (Jax/Flax & PyTorch) @ 🤗Transformers
  ☆49Updated 2 years ago
• coastalcph / hierarchical-transformers
  Hierarchical Attention Transformers (HAT)
  ☆59Updated last year
• peterbhase / SLAG-Belief-Updating
  Code for paper "Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs"
  ☆28Updated 3 years ago
• sileod / tasknet
  Easy modernBERT fine-tuning and multi-task learning
  ☆63Updated 4 months ago
• gchhablani / multilingual-vqa
  Repository for Multilingual-VQA task created during HuggingFace JAX/Flax community week.
  ☆34Updated 4 years ago
• orevaahia / magnet-tokenization
  ☆13Updated 11 months ago
• catie-aq / flashT5
  A fast implementation of T5/UL2 in PyTorch using Flash Attention
  ☆112Updated last month
• google-research / t5x_retrieval
  ☆101Updated 2 years ago
• thakur-nandan / income
  INCOME: An Easy Repository for Training and Evaluation of Index Compression Methods in Dense Retrieval. Includes BPR and JPQ.
  ☆24Updated 2 years ago
• alon-albalak / FLAD
  Few-shot Learning with Auxiliary Data
  ☆31Updated last year
• google-research-datasets / swim-ir
  SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…
  ☆49Updated 2 years ago
• bltlab / seqscore
  SeqScore: Scoring for named entity recognition and other sequence labeling tasks
  ☆23Updated 8 months ago
• ltgoslo / gpt-bert
  Official implementation of "GPT or BERT: why not both?"
  ☆62Updated 4 months ago
• alexa / ramen
  A software for transferring pre-trained English models to foreign languages
  ☆19Updated 2 years ago
• guilhermemr04 / scaling-zero-shot-retrieval
  No Parameter Left Behind: How Distillation and Model Size Affect Zero-Shot Retrieval
  ☆29Updated 3 years ago
• huggingface / that_is_good_data
  ☆65Updated 2 years ago
• malteos / scincl
  Neighborhood Contrastive Learning for Scientific Document Representations with Citation Embeddings (EMNLP 2022 paper)
  ☆72Updated 3 years ago
• CPJKU / wechsel
  Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.
  ☆85Updated last year
• g8a9 / ear
  Code associated with the paper "Entropy-based Attention Regularization Frees Unintended Bias Mitigation from Lists"
  ☆50Updated 3 years ago
• gucci-j / light-transformer-emnlp2021
  EMNLP 2021 - Frustratingly Simple Pretraining Alternatives to Masked Language Modeling
  ☆34Updated 4 years ago
• oriram / spider
  ☆54Updated 2 years ago