Lightweight toolkit package to train and fine-tune 1.58bit Language models
☆149Aug 18, 2026Updated 2 months ago
Alternatives and similar repositories for onebitllms
Users that are interested in onebitllms are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Single-thread, end-to-end C++ implementation of the Bitnet (1.58-bit weight) model☆15Nov 17, 2024Updated last year
- Thin wrapper around GGML to make life easier☆48Jul 26, 2026Updated 2 months ago
- Training SLMs for reasoning-intensive re-ranking☆11Jul 18, 2025Updated last year
- All information and news with respect to Falcon-H1 series☆127Oct 9, 2025Updated last year
- The repo for the article: CSPG: Crossing Sparse Proximity Graphs for Approximate Nearest Neighbor Search☆12Dec 12, 2024Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- YASEM - Yet Another Splade|Sparse Embedder - A simple and efficient library for SPLADE embeddings☆13May 22, 2025Updated last year
- An LLM Client for the PS Vita☆14Jun 23, 2025Updated last year
- ☆54Jul 18, 2024Updated 2 years ago
- a tool for gerenate dataset from doc☆13Jul 31, 2025Updated last year
- Official Repository for "Hypencoder: Hypernetworks for Information Retrieval"☆41Sep 20, 2025Updated last year
- An extention to the GaLore paper, to perform Natural Gradient Descent in low rank subspace☆19Oct 21, 2024Updated 2 years ago
- Sparse Embedding Compression for Scalable Retrieval in Recommender Systems☆39Nov 21, 2025Updated 11 months ago
- Efficient non-uniform quantization with GPTQ for GGUF☆67Sep 17, 2025Updated last year
- ☆16May 24, 2026Updated 4 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Personal voice assistant, with voice interruption and Twilio support☆18Feb 24, 2025Updated last year
- Trully flash implementation of DeBERTa disentangled attention mechanism.☆95Oct 14, 2026Updated last week
- Latent Large Language Models☆19Aug 24, 2024Updated 2 years ago
- Linear Relational Embeddings (LREs) and Linear Relational Concepts (LRCs) for LLMs in PyTorch☆11Aug 7, 2024Updated 2 years ago
- Minimalistic large language model 3D-parallelism training☆2,844Oct 8, 2026Updated 2 weeks ago
- Pre-train Static Word Embeddings☆111Sep 30, 2026Updated 3 weeks ago
- BitLinear implementation☆38Jul 8, 2026Updated 3 months ago
- Developing K - a language model to generate OPENSCAD code from prompt☆19Dec 3, 2025Updated 10 months ago
- ☆13Apr 2, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Train your own small bitnet model☆87Oct 20, 2024Updated 2 years ago
- DPO, but faster 🚀☆51Dec 6, 2024Updated last year
- Code for Retrofitting Large Language Models with Dynamic Tokenization.☆14Jul 22, 2025Updated last year
- A minimal re-implementation of orthogonal fine-tuning (OFT), a diffusion method, for LLMs. Based on nanoGPT and minLoRA.☆14Nov 17, 2023Updated 2 years ago
- Official implementation of Half-Quadratic Quantization (HQQ)☆960Feb 26, 2026Updated 7 months ago
- Starbucks: Improved Training for 2D Matryoshka Embeddings☆26Jun 30, 2025Updated last year
- Python library to use Pleias-RAG models☆72Jul 1, 2026Updated 3 months ago
- OpenAPI specifications => MCP (Model Context Protocol) tools☆19Dec 9, 2024Updated last year
- Codebase for Context-aware Meta-learned Loss Scaling (CaMeLS). https://arxiv.org/abs/2305.15076.☆26Jan 23, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A replication of "Relaxed Recursive Transformers: Effective Parameter Sharing with Layer-wise LoRA" by Bae et al.☆14Aug 26, 2025Updated last year
- ☆11Sep 22, 2023Updated 3 years ago
- An Open Source Toolkit For LLM Distillation☆1,084May 12, 2026Updated 5 months ago
- GEMMs with metal☆26Oct 5, 2026Updated 2 weeks ago
- Repo hosting codes and materials related to speeding LLMs' inference using token merging.☆37Oct 9, 2025Updated last year
- chrome & firefox extension to chat with webpages: local llms☆132Dec 20, 2024Updated last year
- Running Microsoft's BitNet inference framework via FastAPI, Uvicorn and Docker.☆42Jul 2, 2025Updated last year