Alternatives and similar repositories for next-level-bert

Users that are interested in next-level-bert are comparing it to the libraries listed below

• Leukas / CUTE
  ☆14Updated this week
• ltgoslo / ltg-bert
  LTG-Bert
  ☆33Updated last year
• allenai / EmbeddingRecycling
  Embedding Recycling for Language models
  ☆39Updated 2 years ago
• g8a9 / ear
  Code associated with the paper "Entropy-based Attention Regularization Frees Unintended Bias Mitigation from Lists"
  ☆49Updated 3 years ago
• sileod / tasknet
  Easy modernBERT fine-tuning and multi-task learning
  ☆61Updated 2 months ago
• JHU-CLSP / ettin-encoder-vs-decoder
  State-of-the-art paired encoder and decoder models (17M-1B params)
  ☆45Updated last month
• huggingface / olm-training
  Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
  ☆95Updated 2 years ago
• orevaahia / magnet-tokenization
  ☆13Updated 9 months ago
• wietsedv / xpos
  Make the Best of Cross-lingual Transfer: Evidence from POS Tagging with over 100 Languages (ACL 2022)
  ☆19Updated 3 years ago
• konstantinjdobler / focus
  [EMNLP'23] Official Code for "FOCUS: Effective Embedding Initialization for Monolingual Specialization of Multilingual Models"
  ☆34Updated 3 months ago
• MeLeLBGU / SaGe
  Code for SaGe subword tokenizer (EACL 2023)
  ☆26Updated 9 months ago
• ielab / Starbucks
  Starbucks: Improved Training for 2D Matryoshka Embeddings
  ☆21Updated 2 months ago
• thevasudevgupta / bigbird
  Google's BigBird (Jax/Flax & PyTorch) @ 🤗Transformers
  ☆49Updated 2 years ago
• martiansideofthemoon / relic-retrieval
  Official codebase accompanying our ACL 2022 paper "RELiC: Retrieving Evidence for Literary Claims" (https://relic.cs.umass.edu).
  ☆20Updated 3 years ago
• TristanThrush / perplexity-correlations
  Simple and scalable tools for data-driven pretraining data selection.
  ☆27Updated 3 months ago
• Knowledgator / FlashDeBERTa
  Trully flash implementation of DeBERTa disentangled attention mechanism.
  ☆63Updated 2 weeks ago
• allenai / smashed
  SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batchi…
  ☆33Updated last year
• bltlab / seqscore
  SeqScore: Scoring for named entity recognition and other sequence labeling tasks
  ☆23Updated 6 months ago
• malteos / scincl
  Neighborhood Contrastive Learning for Scientific Document Representations with Citation Embeddings (EMNLP 2022 paper)
  ☆71Updated 2 years ago
• alon-albalak / FLAD
  Few-shot Learning with Auxiliary Data
  ☆31Updated last year
• alexa / ramen
  A software for transferring pre-trained English models to foreign languages
  ☆19Updated 2 years ago
• coastalcph / hierarchical-transformers
  Hierarchical Attention Transformers (HAT)
  ☆58Updated last year
• IBM / model-recycling
  Ranking of fine-tuned HF models as base models.
  ☆36Updated 4 months ago
• nreimers / se-pytorch-xla
  ☆21Updated 4 years ago
• google-research-datasets / swim-ir
  SWIM-IR is a Synthetic Wikipedia-based Multilingual Information Retrieval training set with 28 million query-passage pairs spanning 33 la…
  ☆49Updated last year
• huggingface / that_is_good_data
  ☆65Updated 2 years ago
• adapter-hub / hgiyt
  Research code for the paper "How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models"
  ☆27Updated 3 years ago
• UKPLab / eacl2024-lagonn
  Source code and data for Like a Good Nearest Neighbor
  ☆30Updated 8 months ago
• malteos / llm-datasets
  A collection of datasets for language model pretraining including scripts for downloading, preprocesssing, and sampling.
  ☆61Updated last year
• CPJKU / wechsel
  Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.
  ☆84Updated last year