Modeling code for a BitNet b1.58 Llama-style model.
☆25Apr 30, 2024Updated last year
Alternatives and similar repositories for bitnet
Users that are interested in bitnet are comparing it to the libraries listed below
Sorting:
- QLoRA: Efficient Finetuning of Quantized LLMs☆11Jul 22, 2023Updated 2 years ago
- [COLM 2025] "C3PO: Critical-Layer, Core-Expert, Collaborative Pathway Optimization for Test-Time Expert Re-Mixing"☆20Apr 9, 2025Updated 11 months ago
- 4-bit Shampoo for Memory-Efficient Network Training (NeurIPS 2024)☆13Feb 13, 2025Updated last year
- alternative way to calculating self attention☆18May 25, 2024Updated last year
- Unofficial implementations of block/layer-wise pruning methods for LLMs.☆78Apr 29, 2024Updated last year
- 🌳 MCTS-inspired parallel beam search for conversation optimization. Explore multiple dialogue strategies simultaneously, stress-test a…☆35Jan 18, 2026Updated 2 months ago
- ☆13Apr 25, 2024Updated last year
- KANs and MLPs☆12Jun 7, 2024Updated last year
- ☆13Jun 22, 2025Updated 9 months ago
- Train to 94% on CIFAR-10 in 4.4 seconds on a single A100☆12Dec 30, 2023Updated 2 years ago
- Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.☆19Jul 24, 2025Updated 7 months ago
- Maximal Update Parametrization (μP) with Flax & Optax.☆16Dec 27, 2023Updated 2 years ago
- Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free☆233Oct 31, 2024Updated last year
- An implementation of DecorrelatedBN by tensorflow☆13Jun 30, 2022Updated 3 years ago
- Simple GRPO scripts and configurations.☆59Feb 6, 2025Updated last year
- ☆16Oct 20, 2025Updated 5 months ago
- Bullseye Polytope Clean-Label Poisoning Attack☆15Nov 5, 2020Updated 5 years ago
- A video scene detection algorithm is designed to detect a variety of different scenes within a video. There is a very simple definition f…☆10Jan 4, 2022Updated 4 years ago
- ☆21Sep 6, 2021Updated 4 years ago
- ☆21Jan 23, 2024Updated 2 years ago
- Token-level adaptation of LoRA matrices for downstream task generalization.☆15Apr 14, 2024Updated last year
- Orthogonal Matching Pursuit, parallelized on both CPU and GPU. 100x+ Speedup☆16Mar 8, 2026Updated 2 weeks ago
- Multipack distributed sampler for fast padding-free training of LLMs☆206Aug 10, 2024Updated last year
- The official code for our EMNLP 2022 long paper [Breaking the Representation Bottleneck of Chinese Characters: Neural Machine Translation…☆26Sep 10, 2025Updated 6 months ago
- [ICML 2025] M-STAR (Multimodal Self-Evolving TrAining for Reasoning) Project. Diving into Self-Evolving Training for Multimodal Reasoning☆71Jul 13, 2025Updated 8 months ago
- ☆12Jul 6, 2023Updated 2 years ago
- Language modeling with linear-cost context☆117Sep 25, 2025Updated 5 months ago
- Train vision models using JAX and 🤗 transformers☆101Dec 14, 2025Updated 3 months ago
- 🎨 Add text overlays to segmented objects in your images using AI. Powered by Meta's SAM2 for segmentation, running entirely in your brow…☆22Feb 15, 2025Updated last year
- interact with your robot in JS, inspired by LeRobot☆37Nov 14, 2025Updated 4 months ago
- ☆26Jan 14, 2025Updated last year
- Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.☆32Jun 5, 2025Updated 9 months ago
- Collections of RLxLM experiments using minimal codes☆14Feb 17, 2025Updated last year
- VeLO optimizer in PyTorch☆20Feb 6, 2023Updated 3 years ago
- An llm wrapper for OpenAI☆12Dec 14, 2024Updated last year
- ☆23Dec 22, 2023Updated 2 years ago
- Node.js library to copy files between several storage sources (ftp, http/https, s3, ssh, local, ...)☆11Oct 20, 2021Updated 4 years ago
- My learnings (publicly) on RAG systems☆14Jan 2, 2024Updated 2 years ago
- ☆11Dec 11, 2024Updated last year