Alternatives and similar repositories for next-level-bert

Users that are interested in next-level-bert are comparing it to the libraries listed below

• ltgoslo / ltg-bert
  LTG-Bert
  ☆34Updated last year
• Leukas / CUTE
  ☆14Updated last month
• allenai / EmbeddingRecycling
  Embedding Recycling for Language models
  ☆38Updated 2 years ago
• JHU-CLSP / ettin-encoder-vs-decoder
  State-of-the-art paired encoder and decoder models (17M-1B params)
  ☆50Updated 2 months ago
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆96Updated 2 years ago
• orevaahia / magnet-tokenization
  ☆13Updated 10 months ago
• sileod / tasknet
  Easy modernBERT fine-tuning and multi-task learning
  ☆61Updated 3 months ago
• ielab / Starbucks
  Starbucks: Improved Training for 2D Matryoshka Embeddings
  ☆22Updated 3 months ago
• MeLeLBGU / SaGe
  Code for SaGe subword tokenizer (EACL 2023)
  ☆26Updated 10 months ago
• google-research-datasets / swim-ir
  SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…
  ☆49Updated last year
• bltlab / seqscore
  SeqScore: Scoring for named entity recognition and other sequence labeling tasks
  ☆23Updated 7 months ago
• konstantinjdobler / focus
  [EMNLP'23] Official Code for "FOCUS: Effective Embedding Initialization for Monolingual Specialization of Multilingual Models"
  ☆34Updated 4 months ago
• alon-albalak / FLAD
  Few-shot Learning with Auxiliary Data
  ☆31Updated last year
• malteos / scincl
  Neighborhood Contrastive Learning for Scientific Document Representations with Citation Embeddings (EMNLP 2022 paper)
  ☆71Updated 2 years ago
• Knowledgator / FlashDeBERTa
  Trully flash implementation of DeBERTa disentangled attention mechanism.
  ☆66Updated 3 weeks ago
• CPJKU / wechsel
  Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.
  ☆84Updated last year
• TristanThrush / perplexity-correlations
  Simple and scalable tools for data-driven pretraining data selection.
  ☆28Updated 4 months ago
• guy-dar / embedding-space
  ☆55Updated 2 years ago
• g8a9 / ear
  Code associated with the paper "Entropy-based Attention Regularization Frees Unintended Bias Mitigation from Lists"
  ☆50Updated 3 years ago
• wietsedv / xpos
  Make the Best of Cross-lingual Transfer: Evidence from POS Tagging with over 100 Languages (ACL 2022)
  ☆19Updated 3 years ago
• ikergarcia1996 / T-Projection
  T-Projection is a method to perform high-quality Annotation Projection of Sequence Labeling datasets.
  ☆13Updated last year
• catie-aq / flashT5
  A fast implementation of T5/UL2 in PyTorch using Flash Attention
  ☆107Updated 7 months ago
• gucci-j / light-transformer-emnlp2021
  EMNLP 2021 - Frustratingly Simple Pretraining Alternatives to Masked Language Modeling
  ☆34Updated 3 years ago
• NathanGodey / headless-lm
  Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…
  ☆27Updated last year
• thakur-nandan / income
  INCOME: An Easy Repository for Training and Evaluation of Index Compression Methods in Dense Retrieval. Includes BPR and JPQ.
  ☆24Updated 2 years ago
• ltgoslo / gpt-bert
  Official implementation of "GPT or BERT: why not both?"
  ☆61Updated 2 months ago
• cisnlp / MEXA
  🔍 Multilingual Evaluation of English-Centric LLMs via Cross-Lingual Alignment
  ☆11Updated 6 months ago
• ThomasScialom / T0_continual_learning
  Adding new tasks to T0 without catastrophic forgetting
  ☆33Updated 2 years ago
• ottowg / gsap-ner
  ☆10Updated last year
• thevasudevgupta / bigbird
  Google's BigBird (Jax/Flax & PyTorch) @ 🤗Transformers
  ☆49Updated 2 years ago