Bringing BERT into modernity via both architecture changes and scaling
☆1,784Mar 1, 2026Updated 8 months ago
Alternatives and similar repositories for ModernBERT
Users that are interested in ModernBERT are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Late Interaction Models Training & Retrieval☆912Jul 23, 2026Updated 3 months ago
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,642Dec 20, 2025Updated 10 months ago
- Efficient few-shot learning with Sentence Transformers☆2,869Updated this week
- Train Models Contrastively in Pytorch☆806Mar 26, 2025Updated last year
- Code for 'LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders'☆1,731Apr 4, 2026Updated 7 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…☆3,977May 17, 2025Updated last year
- Fast State-of-the-Art Static Embeddings☆2,285Nov 11, 2026Updated last week
- ☆109Jun 2, 2025Updated last year
- Fast BM25 search in Python, powered by Numpy and Numba☆1,827Updated this week
- ColBERT: state-of-the-art neural search (SIGIR'20, TACL'21, NeurIPS'21, NAACL'22, CIKM'22, ACL'23, EMNLP'23)☆3,960Oct 14, 2025Updated last year
- ☆55Feb 10, 2025Updated last year
- MTEB: State-of-the-art evaluation of embeddings across languages and modalities☆3,518Updated this week
- Retrieval and Retrieval-augmented LLMs☆12,344Oct 27, 2026Updated 3 weeks ago
- Train transformer language models with reinforcement learning.☆19,745Updated this week
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Generalist and Lightweight Model for Named Entity Recognition (Extract any entity types from texts)☆4,277Nov 11, 2026Updated last week
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆95Oct 31, 2026Updated 2 weeks ago
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆3,463Updated this week
- PyTorch native post-training library☆5,818Nov 9, 2026Updated last week
- DSPy: The framework for programming—not prompting—language models☆39,109Updated this week
- A massively multilingual modern encoder language model☆168Jan 20, 2026Updated 9 months ago
- ☆103Jul 4, 2025Updated last year
- Fine-tune ModernBERT with custom tokenizers, curriculum learning, and next-gen optimizers.☆73Jan 16, 2026Updated 10 months ago
- 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.☆21,907Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Fast Multimodal Semantic Deduplication & Filtering☆979Nov 11, 2026Updated last week
- State-of-the-Art Embeddings, Retrieval, and Reranking☆19,289Updated this week
- State-of-the-art paired encoder and decoder models (17M-1B params)☆95Aug 6, 2025Updated last year
- Structured Outputs☆16,012Sep 21, 2026Updated last month
- Fast and memory-efficient exact attention☆25,316Updated this week
- Accessible large language models via k-bit quantization for PyTorch.☆8,543Nov 2, 2026Updated 2 weeks ago
- Tools for merging pretrained large language models.☆7,475Oct 31, 2026Updated 2 weeks ago
- Code for BLT research paper☆2,074Nov 3, 2025Updated last year
- code for training & evaluating Contextual Document Embedding models☆207May 14, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆161Dec 2, 2024Updated last year
- A blazing fast inference solution for text embeddings models☆5,128Updated this week
- Go ahead and axolotl questions☆12,738Updated this week
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.☆3,425Updated this week
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆2,587Updated this week
- Large Language Model Text Generation Inference☆10,876Mar 21, 2026Updated 7 months ago
- Minimalistic large language model 3D-parallelism training☆2,864Oct 8, 2026Updated last month
Are these results useful?