Fine-tune ModernBERT with custom tokenizers, curriculum learning, and next-gen optimizers.
☆74Jan 16, 2026Updated 6 months ago
Alternatives and similar repositories for modernbert-finetune
Users that are interested in modernbert-finetune are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- utilities for loading and running text embeddings with onnx☆46Aug 16, 2025Updated 11 months ago
- ☆17Jan 31, 2025Updated last year
- Code Roberta version of RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-Encoder☆10Mar 16, 2023Updated 3 years ago
- Library for evaluating RAG using Nuclia's models☆18Jul 31, 2024Updated 2 years ago
- Using modal.com to process FineWeb-edu data☆20Apr 11, 2026Updated 3 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Bringing BERT into modernity via both architecture changes and scaling☆1,708Mar 1, 2026Updated 5 months ago
- Pre-train Static Word Embeddings☆109Jun 9, 2026Updated 2 months ago
- NOAH's Corpus: Part-of-Speech Tagging for Swiss German☆12Jan 6, 2023Updated 3 years ago
- YASEM - Yet Another Splade|Sparse Embedder - A simple and efficient library for SPLADE embeddings☆13May 22, 2025Updated last year
- A massively multilingual modern encoder language model☆148Jan 20, 2026Updated 6 months ago
- Using short models to classify long texts☆21Mar 8, 2023Updated 3 years ago
- Official implementation of "BERTs are Generative In-Context Learners"☆32Mar 14, 2025Updated last year
- MLX binary vectors and associated algorithms.☆14Mar 13, 2025Updated last year
- My NER Experiments with ModernBERT and Ettin☆29Jul 17, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Use spaCy for NLP and output to the FoLiA XML format.☆12Feb 27, 2024Updated 2 years ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆151Jan 7, 2026Updated 7 months ago
- Simple GRPO scripts and configurations.☆59Feb 6, 2025Updated last year
- This repository contains the training and evaluation code for llm-jp-modernbert-base.☆17Jun 17, 2025Updated last year
- CEBaB: Estimating the Causal Effects of Real-World Concepts on NLP Model Behavior☆13Sep 21, 2022Updated 3 years ago
- alternative way to calculating self attention☆18May 25, 2024Updated 2 years ago
- A simple MLX implementation for pretraining LLMs on Apple Silicon.☆85Aug 20, 2025Updated 11 months ago
- ☆17Feb 23, 2026Updated 5 months ago
- Russian IR benchmark☆16Jul 16, 2026Updated 3 weeks ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- An Efficent BPE Algorithm Faster then Hugging Face Tokenizer's Implementation☆13Sep 9, 2024Updated last year
- A RAG that can scale 🧑🏻💻☆11May 28, 2024Updated 2 years ago
- Smart commit messages☆18Oct 25, 2024Updated last year
- Implementation of ModernBERT in MLX☆21Jan 7, 2026Updated 7 months ago
- The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…☆161Jul 14, 2025Updated last year
- sequence tagging with spaCy and crfsuite☆21Mar 18, 2023Updated 3 years ago
- Official implementation of the ICML 2024 paper RoSA (Robust Adaptation)☆46May 20, 2026Updated 2 months ago
- Cuda implemenation of flash-kmeans, 2x faster☆23May 8, 2026Updated 3 months ago
- Official Repository for "Hypencoder: Hypernetworks for Information Retrieval"☆41Sep 20, 2025Updated 10 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- This repository contains an easy and intuitive approach to use SetFit in combination with spaCy.☆84Aug 31, 2023Updated 2 years ago
- Universal text artifact optimizer using LLM-powered iterative search☆18Mar 3, 2026Updated 5 months ago
- Library for fast text representation and classification.☆31Jan 9, 2024Updated 2 years ago
- ☆10Oct 2, 2024Updated last year
- Starbucks: Improved Training for 2D Matryoshka Embeddings☆25Jun 30, 2025Updated last year
- Vocabulary Trimming (VT) is a model compression technique, which reduces a multilingual LM vocabulary to a target language by deleting ir…☆67Oct 25, 2024Updated last year
- Code for the MTEB leaderboard☆32Feb 4, 2025Updated last year