jukofyork / transplant-vocab
Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.
☆24Updated 3 weeks ago
Alternatives and similar repositories for transplant-vocab:
Users that are interested in transplant-vocab are comparing it to the libraries listed below
- entropix style sampling + GUI☆25Updated 5 months ago
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆56Updated 2 months ago
- ☆66Updated 11 months ago
- klmbr - a prompt pre-processing technique to break through the barrier of entropy while generating text with LLMs☆71Updated 7 months ago
- ☆60Updated this week
- Easy to use, High Performant Knowledge Distillation for LLMs☆60Updated this week
- ☆121Updated last week
- Easily view and modify JSON datasets for large language models☆74Updated last month
- ☆85Updated 4 months ago
- ☆51Updated 5 months ago
- Glyphs, acting as collaboratively defined symbols linking related concepts, add a layer of multidimensional semantic richness to user-AI …☆49Updated 2 months ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆139Updated 2 months ago
- idea: https://github.com/nyxkrage/ebook-groupchat/☆86Updated 8 months ago
- SLOP Detector and analyzer based on dictionary for shareGPT JSON and text☆67Updated 5 months ago
- Genertaes control vectors for use with llama.cpp in GGUF format.☆22Updated last month
- Video+code lecture on building nanoGPT from scratch☆65Updated 10 months ago
- Low-Rank adapter extraction for fine-tuned transformers models☆173Updated 11 months ago
- An unsupervised model merging algorithm for Transformers-based language models.☆105Updated 11 months ago
- ☆112Updated 4 months ago
- A pipeline parallel training script for LLMs.☆137Updated 3 weeks ago
- Adding a multi-text multi-speaker script (diffe) that is based on a script from asiff00 on issue 61 for Sesame: A Conversational Speech G…☆23Updated 3 weeks ago
- All the world is a play, we are but actors in it.☆49Updated this week
- Distributed Inference for mlx LLm☆87Updated 8 months ago
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆77Updated 4 months ago
- Interact with a AI Game-engine that keep building its rules and world as you play, adapted to your gameplay.☆42Updated 10 months ago
- ☆53Updated 10 months ago
- Gradio based tool to run opensource LLM models directly from Huggingface☆90Updated 10 months ago
- "a towel is about the most massively useful thing an interstellar AI hitchhiker can have"☆48Updated 6 months ago
- Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)☆90Updated 3 months ago
- Guaranteed Structured Output from any Language Model via Hierarchical State Machines☆124Updated last week