Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.
☆54Oct 29, 2025Updated 11 months ago
Alternatives and similar repositories for transplant-vocab
Users that are interested in transplant-vocab are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Evaluate state-of-the-art sparse embedding models on the LIMIT dataset (`limit-small` and `limit`) from google's paper `On the Theoretica…☆16Sep 4, 2025Updated last year
- ☆101Mar 28, 2026Updated 6 months ago
- easy exllama interface w/ automation & evals☆19Sep 25, 2026Updated 2 weeks ago
- Generate a llama-quantize command to copy the quantization parameters of any GGUF☆36Apr 20, 2026Updated 5 months ago
- Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models☆270Apr 23, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆18Jul 1, 2025Updated last year
- A simple library for working with Hugging Face models.☆14Dec 30, 2024Updated last year
- Produce your own Dynamic 3.0 Quants and achieve optimum accuracy & SOTA quantization performance! Input a target size and the toolchain w…☆170Sep 11, 2026Updated 3 weeks ago
- Deployment a light and full OpenAI API for production with vLLM to support /v1/embeddings with all embeddings models.☆45Jul 16, 2024Updated 2 years ago
- ☆17Jan 30, 2023Updated 3 years ago
- ☆28Feb 16, 2026Updated 7 months ago
- ☆19Oct 18, 2025Updated 11 months ago
- A open webui function for better R1 experience☆77Mar 7, 2025Updated last year
- Easily view and modify JSON datasets for large language models☆92May 16, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Code of fine-tuning neural sparse models and training from scratch. #SIGIR2025☆26Mar 11, 2026Updated 6 months ago
- ☆16Oct 14, 2024Updated last year
- Chatbot-to-speech using Orpheus TTS model. Interactive console app.☆21May 1, 2025Updated last year
- 한국에서 인터넷 검열을 피하는 방법☆17Nov 8, 2016Updated 9 years ago
- Vocabulary Trimming (VT) is a model compression technique, which reduces a multilingual LM vocabulary to a target language by deleting ir…☆70Oct 25, 2024Updated last year
- setup the env for vllm users☆16Oct 31, 2023Updated 2 years ago
- A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.☆63Oct 13, 2023Updated 2 years ago
- An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs☆1,624Updated this week
- The official API server for Exllama. OAI compatible, lightweight, and fast.☆1,459Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Lightweight C inference for Qwen3 GGUF. Multiturn prefix caching & batch processing.☆26Sep 1, 2025Updated last year
- A minimal CLI tool for piping anything into an LLM.☆21Jan 1, 2026Updated 9 months ago
- notes on langchain☆18Mar 20, 2026Updated 6 months ago
- High-throughput long-context LLMs. Scaling context via RandNLA and massive vocab capacity through MAXIS Loss and Fisher-SVD.☆28Sep 13, 2026Updated 3 weeks ago
- a set of scripts to easily convert all training data from huggingface into alpaca instruct or sharegpt format, which should allow for eas…☆20Mar 14, 2025Updated last year
- ☆19Jul 4, 2025Updated last year
- PyTorch code of "Training a Vision Transformer from scratch in less than 24 hours with 1 GPU" (HiTY workshop at Neurips 2022)☆28Aug 30, 2023Updated 3 years ago
- A proxy that hosts multiple single-model runners such as LLama.cpp and vLLM☆12May 30, 2025Updated last year
- Data and models for the paper "Configurable Safety Tuning of Language Models with Synthetic Preference Data"☆17Jul 27, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- realtime conversational dynamics☆19Mar 19, 2025Updated last year
- Ship a prebuilt Wine environment driven by box86 & box64 on Ubuntu Touch☆13Jul 12, 2026Updated 2 months ago
- PARD: Accelerating LLM Inference with Low-Cost PARallel Draft Model Adaptation (ICLR 26)☆36Jun 10, 2026Updated 4 months ago
- A chess arena for large language models☆41May 22, 2025Updated last year
- ☆23May 14, 2026Updated 4 months ago
- Qwen LLM in the mac menu bar <3☆26Mar 12, 2025Updated last year
- German "Who Wants To Be A Millionaire" LLM Benchmarking.☆50Sep 6, 2026Updated last month