reka-ai / rekaquantLinks
☆49Updated this week
Alternatives and similar repositories for rekaquant
Users that are interested in rekaquant are comparing it to the libraries listed below
Sorting:
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆54Updated 5 months ago
- Lightweight toolkit package to train and fine-tune 1.58bit Language models☆81Updated last month
- Simple GRPO scripts and configurations.☆59Updated 5 months ago
- Latent Large Language Models☆18Updated 10 months ago
- Lego for GRPO☆28Updated last month
- ☆38Updated 11 months ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆140Updated 4 months ago
- Pivotal Token Search☆109Updated last week
- An OpenAI API compatible LLM inference server based on ExLlamaV2.☆25Updated last year
- entropix style sampling + GUI☆26Updated 8 months ago
- Modified Beam Search with periodical restart☆12Updated 10 months ago
- Simple LLM inference server☆20Updated last year
- ☆26Updated last year
- OpenPipe Reinforcement Learning Experiments☆25Updated 3 months ago
- Very minimal (and stateless) agent framework☆44Updated 6 months ago
- Fast approximate inference on a single GPU with sparsity aware offloading☆38Updated last year
- Official Repository for Task-Circuit Quantization☆20Updated last month
- Project code for training LLMs to write better unit tests + code☆21Updated last month
- ☆48Updated 5 months ago
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆101Updated 4 months ago
- RWKV-7: Surpassing GPT☆92Updated 7 months ago
- AnyModal is a Flexible Multimodal Language Model Framework for PyTorch☆100Updated 6 months ago
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆88Updated last week
- An AI character interaction system with emotional modeling and advanced memory management☆16Updated 8 months ago
- look how they massacred my boy☆63Updated 8 months ago
- ☆52Updated 8 months ago
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆69Updated last year
- The hearth of The Pulsar App, fast, secure and shared inference with modern UI☆57Updated 7 months ago
- ☆22Updated 3 months ago
- ☆28Updated 10 months ago