Alternatives and similar repositories for NeoBERT

Users that are interested in NeoBERT are comparing it to the libraries listed below

• Knowledgator / FlashDeBERTa
  Trully flash implementation of DeBERTa disentangled attention mechanism.
  ☆63Updated 2 weeks ago
• AnswerDotAI / fastkmeans
  ☆69Updated 2 months ago
• jxmorris12 / bm25_pt
  minimal pytorch implementation of bm25 (with sparse tensors)
  ☆104Updated last year
• ltgoslo / gpt-bert
  Official implementation of "GPT or BERT: why not both?"
  ☆58Updated last month
• bminixhofer / tokenkit
  A toolkit implementing advanced methods to transfer models and model knowledge across tokenizers.
  ☆46Updated 2 months ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆49Updated 7 months ago
• MinishLab / tokenlearn
  Pre-train Static Word Embeddings
  ☆85Updated last week
• NathanGodey / headless-lm
  Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…
  ☆27Updated last year
• JHU-CLSP / mmBERT
  A massively multilingual modern encoder language model
  ☆80Updated last week
• LAGoM-NLP / transtokenizer
  ☆51Updated 7 months ago
• Knowledgator / LiqFit
  Efficient few-shot learning with cross-encoders.
  ☆58Updated last year
• MeLeLBGU / SaGe
  Code for SaGe subword tokenizer (EACL 2023)
  ☆26Updated 9 months ago
• s-smits / modernbert-finetune
  Fine-tune ModernBERT on a large Dataset with Custom Tokenizer Training
  ☆67Updated 7 months ago
• davanstrien / haiku-dpo
  Using open source LLMs to build synthetic datasets for direct preference optimization
  ☆65Updated last year
• catie-aq / flashT5
  A fast implementation of T5/UL2 in PyTorch using Flash Attention
  ☆107Updated 6 months ago
• Zyphra / Zyda_processing
  ☆39Updated last year
• nbroad1881 / strideformer
  Using short models to classify long texts
  ☆21Updated 2 years ago
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆48Updated last year
• warner-benjamin / optimi
  Fast, Modern, and Low Precision PyTorch Optimizers
  ☆109Updated 2 weeks ago
• JHU-CLSP / ettin-encoder-vs-decoder
  State-of-the-art paired encoder and decoder models (17M-1B params)
  ☆45Updated last month
• google-research-datasets / QAmeleon
  QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…
  ☆34Updated 2 years ago
• stephantul / skeletoken
  Datamodels for hugging face tokenizers
  ☆47Updated last week
• mixedbread-ai / mxbai-rerank
  Crispy reranking models by Mixedbread
  ☆35Updated this week
• luyug / magix
  Supercharge huggingface transformers with model parallelism.
  ☆77Updated last month
• trapoom555 / Language-Model-STS-CFT
  Improving Text Embedding of Language Models Using Contrastive Fine-tuning
  ☆64Updated last year
• Aleph-Alpha-Research / trigrams
  ☆58Updated 4 months ago
• ielab / Starbucks
  Starbucks: Improved Training for 2D Matryoshka Embeddings
  ☆21Updated 2 months ago
• liujch1998 / infini-gram
  ☆66Updated last month
• sileod / tasksource
  Datasets collection and preprocessings framework for NLP extreme multitask learning
  ☆186Updated 2 months ago
• stefan-it / modern-bert-ner
  My NER Experiments with ModernBERT and Ettin
  ☆22Updated 2 months ago