Package to align tokens from different tokenizations.
☆15Mar 25, 2024Updated 2 years ago
Alternatives and similar repositories for merge-tokenizers
Users that are interested in merge-tokenizers are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- T5 Language Models for the Indonesian Language!☆17Mar 6, 2024Updated 2 years ago
- Apply methods described in "Git Re-basin"-paper [1] to arbitrary models --- [1] Ainsworth et al. (https://arxiv.org/abs/2209.04836)☆18Updated this week
- Templates for PolyU PhD thesis and confirmation report☆13Jun 6, 2025Updated last year
- Code for paper "Towards Efficient Pareto Set Approximation via Weight-Ensembling Mixture of Experts"☆11Jul 30, 2026Updated 2 months ago
- [ICLR 2025] Weighted-Reward Preference Optimization for Implicit Model Fusion☆14Mar 17, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- A Generative Agent for Proactive Peer support☆14Oct 12, 2024Updated 2 years ago
- Human I/O, published at CHI 2024, Honorable Mentions Award☆19Jul 24, 2026Updated 2 months ago
- ☆18Aug 19, 2024Updated 2 years ago
- A toolkit implementing advanced methods to transfer models and model knowledge across tokenizers.☆72Jul 6, 2025Updated last year
- FuseAI Project☆93Jan 25, 2025Updated last year
- Codebase the paper "The Remarkable Robustness of LLMs: Stages of Inference?"☆20Jun 11, 2025Updated last year
- Just keeping an eye on the ecosystem.☆24Updated this week
- Linear Mode Connectivity in Multitask and Continual Learning: https://arxiv.org/abs/2010.04495☆13Oct 12, 2020Updated 6 years ago
- Multi-stage LLM agent pipeline for optimizing AI kernels on Intel GPU — from analysis to autotuning.☆23Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Cycles agroecosystem model☆13Jun 11, 2026Updated 4 months ago
- code of cvpr26 paper Symphony☆17Apr 7, 2026Updated 6 months ago
- ☆11Sep 27, 2024Updated 2 years ago
- Benchmark API for Multidomain Language Modeling☆25Aug 26, 2022Updated 4 years ago
- A command-line tool for deduplicating entries in a file or stream.☆15May 23, 2018Updated 8 years ago
- This repository is the implementation of the paper Training Free Pretrained Model Merging (CVPR2024).☆36Mar 5, 2024Updated 2 years ago
- A cargo subcommand for inspecting what changes brings dependency version update into your project☆16Jan 21, 2026Updated 8 months ago
- SIB-200: A Simple, Inclusive, and Big Evaluation Dataset for Topic Classification in 200+ Languages and Dialects☆28May 20, 2026Updated 4 months ago
- [ICML 2025 Oral] This is the official repository of the paper "What Limits Virtual Agent Application? OmniBench: A Scalable Multi-Dimensi…☆23Jun 12, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Pytorch optimizers implementing Hilbert Constrained Gradient Descent☆19May 9, 2019Updated 7 years ago
- Graph algorithms to merge two graphs based on stitching.☆12Oct 18, 2019Updated 7 years ago
- OmniAgent: Audio-Guided Active Perception Agent for Omnimodal Audio-Video Understanding☆27Apr 9, 2026Updated 6 months ago
- ☆14Mar 31, 2022Updated 4 years ago
- Exam summary for Computational Intelligence Lab, ETH Zurich, SS15☆13Aug 16, 2017Updated 9 years ago
- Code for the examples presented in the talk "Training a Llama in your backyard: fine-tuning very large models on consumer hardware" given…☆15Oct 16, 2023Updated 3 years ago
- A repository for organizing our submission to the MEDIQA-Chat Tasks @ ACL-ClinicalNLP 2023☆23Jul 21, 2023Updated 3 years ago
- TokEval: intrinsic quality metrics for tokenizers across natural language, code, and math☆58Aug 31, 2026Updated last month
- The official implementation for the paper "Agent-Omni: Test-Time Multimodal Reasoning via Model Coordination for Understanding Anything".☆23Nov 5, 2025Updated 11 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Shallow baseline models for text in TensorFlow☆12Jul 1, 2017Updated 9 years ago
- [ICML2023] Graph Ladling: Shockingly Simple Parallel GNN Training without Intermediate Communication. Ajay Jaiswal, Shiwei Liu, Tianlong …☆13Aug 24, 2023Updated 3 years ago
- ☆12Nov 7, 2024Updated last year
- DImensionality REduction in JAX☆29Nov 21, 2025Updated 10 months ago
- TensorFlow Implementation of Several Zero-Shot Image Style Transfer Methods☆15Sep 30, 2017Updated 9 years ago
- A script for the statistical learning theory course at ETH☆12Aug 19, 2021Updated 5 years ago
- suffix array construction and searching algorithms for in-memory binary data.☆13Sep 10, 2022Updated 4 years ago