reka-ai / rekaquantLinks
☆62Updated 2 months ago
Alternatives and similar repositories for rekaquant
Users that are interested in rekaquant are comparing it to the libraries listed below
Sorting:
- entropix style sampling + GUI☆27Updated 11 months ago
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆55Updated 7 months ago
- Lightweight toolkit package to train and fine-tune 1.58bit Language models☆89Updated 4 months ago
- GPTQ and efficient search for GGUF☆49Updated 2 weeks ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆146Updated 7 months ago
- Lego for GRPO☆29Updated 4 months ago
- Modified Beam Search with periodical restart☆12Updated last year
- Simple GRPO scripts and configurations.☆59Updated 7 months ago
- Easy to use, High Performant Knowledge Distillation for LLMs☆93Updated 4 months ago
- RWKV-7: Surpassing GPT☆95Updated 10 months ago
- ☆54Updated 10 months ago
- Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.☆42Updated 3 weeks ago
- Nexusflow function call, tool use, and agent benchmarks.☆29Updated 9 months ago
- Pivotal Token Search☆125Updated 2 months ago
- Luth is a state-of-the-art series of fine-tuned LLMs for French☆33Updated this week
- GPT-4 Level Conversational QA Trained In a Few Hours☆64Updated last year
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31Updated last year
- OpenPipe Reinforcement Learning Experiments☆31Updated 6 months ago
- ☆135Updated last year
- ☆57Updated 7 months ago
- Official Repository for Task-Circuit Quantization☆24Updated 4 months ago
- ☆23Updated 8 months ago
- ☆45Updated last year
- Let's create synthetic textbooks together :)☆75Updated last year
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆34Updated last year
- Glyphs, acting as collaboratively defined symbols linking related concepts, add a layer of multidimensional semantic richness to user-AI …☆52Updated 7 months ago
- ☆26Updated last year
- Project code for training LLMs to write better unit tests + code☆21Updated 4 months ago
- ☆51Updated last year
- ☆39Updated last year