Fine-tune ModernBERT with custom tokenizers, curriculum learning, and next-gen optimizers.
☆74Jan 16, 2026Updated last month
Alternatives and similar repositories for modernbert-finetune
Users that are interested in modernbert-finetune are comparing it to the libraries listed below
Sorting:
- utilities for loading and running text embeddings with onnx☆45Aug 16, 2025Updated 6 months ago
- A massively multilingual modern encoder language model☆134Jan 20, 2026Updated last month
- ☆17Jan 31, 2025Updated last year
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆81Feb 10, 2026Updated 3 weeks ago
- Library for evaluating RAG using Nuclia's models☆18Jul 31, 2024Updated last year
- Using modal.com to process FineWeb-edu data☆20Apr 5, 2025Updated 11 months ago
- Model implementation for the contextual embeddings project☆41Jun 2, 2025Updated 9 months ago
- Bringing BERT into modernity via both architecture changes and scaling☆1,632Mar 1, 2026Updated last week
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆150Jan 7, 2026Updated 2 months ago
- Fast search index for SPLADE sparse retrieval models implemented in Python using Numpy and Numba☆36Oct 16, 2025Updated 4 months ago
- Further developed as SyntaxDot: https://github.com/tensordot/syntaxdot☆13Dec 18, 2020Updated 5 years ago
- A Python implementation of an agent swarm system that works with local LLM servers. The system allows you to create multiple agents that …☆11Nov 20, 2024Updated last year
- Use spaCy for NLP and output to the FoLiA XML format.☆12Feb 27, 2024Updated 2 years ago
- Official implementation of "BERTs are Generative In-Context Learners"☆32Mar 14, 2025Updated 11 months ago
- MLX binary vectors and associated algorithms.☆14Mar 13, 2025Updated 11 months ago
- ☆33Nov 21, 2025Updated 3 months ago
- 🤖 Complete reproduction of 'AlphaGo Moment for Model Architecture Discovery' using MLX-LM instead of GPT-4. Autonomous neural architectu…☆27Jul 27, 2025Updated 7 months ago
- Implementation of ModernBERT in MLX☆20Jan 7, 2026Updated 2 months ago
- Entropy Based Sampling and Parallel CoT Decoding☆17Oct 9, 2024Updated last year
- Using short models to classify long texts☆21Mar 8, 2023Updated 3 years ago
- CEBaB: Estimating the Causal Effects of Real-World Concepts on NLP Model Behavior☆13Sep 21, 2022Updated 3 years ago
- Official implementation of the ICML 2024 paper RoSA (Robust Adaptation)☆44Feb 13, 2024Updated 2 years ago
- Smart commit messages☆18Oct 25, 2024Updated last year
- ☆24Nov 19, 2024Updated last year
- Univariate and multivariate time series forecasting, with uncertainty quantification (Python & R)☆13Dec 20, 2025Updated 2 months ago
- ☆11Updated this week
- A single static file as vector database, using the cloud-native flatgeobuf file format and http range requests☆17Oct 28, 2025Updated 4 months ago
- Expert annotated Hallmarks of Cancer Corpus☆21Sep 18, 2018Updated 7 years ago
- alternative way to calculating self attention☆18May 25, 2024Updated last year
- Coreference resolution for German☆16Jun 26, 2017Updated 8 years ago
- YAST - Yet Another SPLADE or Sparse Trainer☆21Jun 16, 2025Updated 8 months ago
- An advanced AI-powered conversational agent leveraging the Llama 3.2 model and Phidata framework. Features include reasoning, natural lan…☆16Oct 29, 2024Updated last year
- FormFill is a CLI tool that uses LLMs to automatically fill out PDF forms.☆29Nov 22, 2024Updated last year
- Applying "Load What You Need: Smaller Versions of Multilingual BERT" to LaBSE☆19Sep 22, 2021Updated 4 years ago
- Unattended Lightweight Text Classifiers with LLM Embeddings☆185Sep 6, 2024Updated last year
- Qwen-WisdomVast is a large model trained on 1 million high-quality Chinese multi-turn SFT data, 200,000 English multi-turn SFT data, and …☆18Apr 12, 2024Updated last year
- A stable, fast and easy-to-use inference library with a focus on a sync-to-async API☆48Sep 26, 2024Updated last year
- The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…☆159Jul 14, 2025Updated 7 months ago
- My NER Experiments with ModernBERT and Ettin☆26Jul 17, 2025Updated 7 months ago