Package to align tokens from different tokenizations.
☆15Mar 25, 2024Updated 2 years ago
Alternatives and similar repositories for merge-tokenizers
Users that are interested in merge-tokenizers are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- SIMPLE: A Gradient Estimator for $k$-subset Sampling☆12Aug 8, 2024Updated 2 years ago
- Apply methods described in "Git Re-basin"-paper [1] to arbitrary models --- [1] Ainsworth et al. (https://arxiv.org/abs/2209.04836)☆17Updated this week
- A lightweight, user-friendly data-plane for LLM training.☆42Sep 10, 2025Updated last year
- [ICLR 2025] Weighted-Reward Preference Optimization for Implicit Model Fusion☆14Mar 17, 2025Updated last year
- This repository holds the code for the NeurIPS 2022 paper, Semantic Probabilistic Layers☆33Dec 4, 2023Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Is Vec2Text Really a Threat toDense Retrieval Systems?☆19Nov 29, 2024Updated last year
- Human I/O, published at CHI 2024, Honorable Mentions Award☆19Jul 24, 2026Updated 2 months ago
- ☆18Aug 19, 2024Updated 2 years ago
- A minimal chinese keywords extraction with BERT☆10Nov 1, 2022Updated 3 years ago
- Repository containing lectures from 2024 Machine Learning course☆19Feb 29, 2024Updated 2 years ago
- ☆14Apr 16, 2024Updated 2 years ago
- Clustered Federated Learning via Gradient-based Partitioning (ICML 2024)☆15Jun 15, 2025Updated last year
- FuseAI Project☆93Jan 25, 2025Updated last year
- Code for "Merging Text Transformers from Different Initializations"☆20Feb 2, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The code repository for "MINGLE: Mixture of Null-Space Gated Low-Rank Experts for Test-Time Continual Model Merging"(NeurIPS25) in PyTorc…☆15Jun 2, 2026Updated 3 months ago
- Just keeping an eye on the ecosystem.☆24Updated this week
- Deep Learning Course, Skoltech, 2024☆16Jun 12, 2024Updated 2 years ago
- Surgically de-slop LLMs☆15Jun 1, 2025Updated last year
- AI plays Doom — pit Vision Language Models against demons and each other. Solo scenarios, deathmatch arena, 1-4 agents with any OpenAI-co…☆20Mar 12, 2026Updated 6 months ago
- ☆22Sep 19, 2024Updated 2 years ago
- Official code for Neural Exploratory Landscape Analysis (https://www.arxiv.org/abs/2408.10672)☆16Apr 13, 2026Updated 5 months ago
- Agentic Keyframe Search for Video Question Answering☆18Jun 30, 2026Updated 2 months ago
- Code for the examples presented in the talk "Training a Llama in your backyard: fine-tuning very large models on consumer hardware" given…☆15Oct 16, 2023Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- SIB-200: A Simple, Inclusive, and Big Evaluation Dataset for Topic Classification in 200+ Languages and Dialects☆27May 20, 2026Updated 4 months ago
- Python console application designed to provide an engaging and visually appealing LLM chat experience on Unix-like consoles or Terminals.