reka-ai / rekaquantLinks
☆58Updated last month
Alternatives and similar repositories for rekaquant
Users that are interested in rekaquant are comparing it to the libraries listed below
Sorting:
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆55Updated 6 months ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆146Updated 6 months ago
- Lego for GRPO☆28Updated 2 months ago
- entropix style sampling + GUI☆27Updated 9 months ago
- Lightweight toolkit package to train and fine-tune 1.58bit Language models☆83Updated 3 months ago
- Simple GRPO scripts and configurations.☆59Updated 6 months ago
- Easy to use, High Performant Knowledge Distillation for LLMs☆90Updated 3 months ago
- ☆54Updated 9 months ago
- Modified Beam Search with periodical restart☆12Updated 11 months ago
- RWKV-7: Surpassing GPT☆94Updated 9 months ago
- ☆66Updated last year
- Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.☆41Updated last month
- Nexusflow function call, tool use, and agent benchmarks.☆29Updated 8 months ago
- Glyphs, acting as collaboratively defined symbols linking related concepts, add a layer of multidimensional semantic richness to user-AI …☆52Updated 6 months ago
- Project code for training LLMs to write better unit tests + code☆21Updated 3 months ago
- GPT-4 Level Conversational QA Trained In a Few Hours☆63Updated last year
- ☆134Updated last year
- ☆26Updated last year
- Fast approximate inference on a single GPU with sparsity aware offloading☆38Updated last year
- OpenPipe Reinforcement Learning Experiments☆30Updated 5 months ago
- ☆51Updated last year
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31Updated last year
- The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models☆22Updated 8 months ago
- Simple LLM inference server☆20Updated last year
- Official Repository for Task-Circuit Quantization☆22Updated 2 months ago
- Modeling code for a BitNet b1.58 Llama-style model.☆25Updated last year
- ☆38Updated last year
- ☆49Updated 6 months ago
- EvaByte: Efficient Byte-level Language Models at Scale☆107Updated 4 months ago
- ☆38Updated last year