Alternatives and similar repositories for NeoBERT

Users that are interested in NeoBERT are comparing it to the libraries listed below

• Knowledgator / FlashDeBERTa
  Trully flash implementation of DeBERTa disentangled attention mechanism.
  ☆66Updated last month
• AnswerDotAI / fastkmeans
  ☆83Updated 3 months ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆50Updated 8 months ago
• jxmorris12 / bm25_pt
  minimal pytorch implementation of bm25 (with sparse tensors)
  ☆104Updated this week
• MinishLab / tokenlearn
  Pre-train Static Word Embeddings
  ☆87Updated last month
• s-smits / modernbert-finetune
  Fine-tune ModernBERT on a large Dataset with Custom Tokenizer Training
  ☆73Updated 2 weeks ago
• catie-aq / flashT5
  A fast implementation of T5/UL2 in PyTorch using Flash Attention
  ☆109Updated this week
• JHU-CLSP / mmBERT
  A massively multilingual modern encoder language model
  ☆104Updated 2 weeks ago
• LAGoM-NLP / transtokenizer
  ☆52Updated 9 months ago
• ltgoslo / gpt-bert
  Official implementation of "GPT or BERT: why not both?"
  ☆61Updated 3 months ago
• bminixhofer / tokenkit
  A toolkit implementing advanced methods to transfer models and model knowledge across tokenizers.
  ☆47Updated 3 months ago
• Knowledgator / TurboT5
  Truly flash T5 realization!
  ☆70Updated last year
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆48Updated last year
• Knowledgator / LiqFit
  Efficient few-shot learning with cross-encoders.
  ☆59Updated last year
• mixedbread-ai / mxbai-rerank
  Crispy reranking models by Mixedbread
  ☆38Updated last month
• JHU-CLSP / ettin-encoder-vs-decoder
  State-of-the-art paired encoder and decoder models (17M-1B params)
  ☆53Updated 2 months ago
• MeLeLBGU / SaGe
  Code for SaGe subword tokenizer (EACL 2023)
  ☆27Updated 11 months ago
• trapoom555 / Language-Model-STS-CFT
  Improving Text Embedding of Language Models Using Contrastive Fine-tuning
  ☆65Updated last year
• Zyphra / Zyda_processing
  ☆39Updated last year
• stephantul / skeletoken
  Datamodels for hugging face tokenizers
  ☆86Updated this week
• liujch1998 / infini-gram
  ☆73Updated 2 months ago
• huggingface / huggingface-inference-toolkit
  Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.
  ☆88Updated last month
• ibm-granite / granite-embedding-models
  ☆45Updated 2 weeks ago
• NathanGodey / headless-lm
  Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…
  ☆27Updated last year
• Aleph-Alpha-Research / trigrams
  ☆57Updated 3 weeks ago
• princeton-nlp / LitSearch
  [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search
  ☆99Updated 11 months ago
• illuin-tech / contextual-embeddings
  Model implementation for the contextual embeddings project
  ☆36Updated 4 months ago
• ielab / Starbucks
  Starbucks: Improved Training for 2D Matryoshka Embeddings
  ☆22Updated 4 months ago
• stefan-it / modern-bert-ner
  My NER Experiments with ModernBERT and Ettin
  ☆22Updated 3 months ago
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆68Updated last year