tiiuae / onebitllmsLinks
Lightweight toolkit package to train and fine-tune 1.58bit Language models
☆80Updated 2 months ago
Alternatives and similar repositories for onebitllms
Users that are interested in onebitllms are comparing it to the libraries listed below
Sorting:
- ☆52Updated last year
- RWKV-7: Surpassing GPT☆92Updated 8 months ago
- Easy to use, High Performant Knowledge Distillation for LLMs☆88Updated 2 months ago
- ☆48Updated 10 months ago
- ☆52Updated 8 months ago
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆55Updated 5 months ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆140Updated 4 months ago
- A repository for research on medium sized language models.☆77Updated last year
- Repo hosting codes and materials related to speeding LLMs' inference using token merging.☆36Updated last year
- ☆53Updated 5 months ago
- Collection of autoregressive model implementation☆85Updated 2 months ago
- ☆134Updated 11 months ago
- Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.☆198Updated last year
- An efficent implementation of the method proposed in "The Era of 1-bit LLMs"☆153Updated 9 months ago
- This is the official repository for Inheritune.☆112Updated 5 months ago
- ☆118Updated 10 months ago
- ☆36Updated last year
- Train, tune, and infer Bamba model☆130Updated last month
- ☆53Updated last week
- QuIP quantization☆54Updated last year
- ☆49Updated last year
- ☆128Updated 3 months ago
- new optimizer☆20Updated 11 months ago
- Query-agnostic KV cache eviction: 3–4× reduction in memory and 2× decrease in latency (Qwen3/2.5, Gemma3, LLaMA3)☆91Updated last week
- Training-free Post-training Efficient Sub-quadratic Complexity Attention. Implemented with OpenAI Triton.☆139Updated this week
- Data preparation code for CrystalCoder 7B LLM☆45Updated last year
- Data preparation code for Amber 7B LLM☆91Updated last year
- PyTorch implementation of models from the Zamba2 series.☆184Updated 5 months ago
- Simple GRPO scripts and configurations.☆59Updated 5 months ago
- My fork os allen AI's OLMo for educational purposes.☆30Updated 7 months ago