Modeling code for a BitNet b1.58 Llama-style model.
☆24Apr 30, 2024Updated 2 years ago
Alternatives and similar repositories for bitnet
Users that are interested in bitnet are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- implementation of https://arxiv.org/pdf/2312.09299☆21Jul 3, 2024Updated 2 years ago
- QLoRA: Efficient Finetuning of Quantized LLMs☆11Jul 22, 2023Updated 3 years ago
- [ICML'25] "Rethinking Addressing in Language Models via Contextualized Equivariant Positional Encoding" by Jiajun Zhu, Peihao Wang, Ruisi…☆15Jun 6, 2025Updated last year
- This repository contains the code of our paper 'Skip \n: A simple method to reduce hallucination in Large Vision-Language Models'.☆15Feb 12, 2024Updated 2 years ago
- Set of scripts to finetune LLMs☆38Mar 30, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- alternative way to calculating self attention☆18May 25, 2024Updated 2 years ago
- 4-bit Shampoo for Memory-Efficient Network Training (NeurIPS 2024)☆13Feb 13, 2025Updated last year
- ☆20Apr 29, 2024Updated 2 years ago
- A repo based on XiLin Li's PSGD repo that extends some of the experiments.☆13Oct 7, 2024Updated 2 years ago
- A fully trainable state space model (SSM)☆16Mar 18, 2025Updated last year
- Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.☆19Jul 24, 2025Updated last year
- Maximal Update Parametrization (μP) with Flax & Optax.☆16Dec 27, 2023Updated 2 years ago
- Simple GRPO scripts and configurations.☆59Feb 6, 2025Updated last year
- An implementation of DecorrelatedBN by tensorflow☆13Jun 30, 2022Updated 4 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free☆234Oct 31, 2024Updated last year
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31May 22, 2024Updated 2 years ago
- ☆19Sep 2, 2026Updated last month
- https://www.kaggle.com/c/siim-acr-pneumothorax-segmentation☆11Sep 11, 2019Updated 7 years ago
- ☆21Sep 6, 2021Updated 5 years ago
- ☆11Jun 14, 2019Updated 7 years ago
- Pack of scripts providing customizable YouTube Music Videos generation.☆11Oct 10, 2023Updated 2 years ago
- Neural network density models for speech separation.☆20Nov 26, 2020Updated 5 years ago
- [ICML 2025] M-STAR (Multimodal Self-Evolving TrAining for Reasoning) Project. Diving into Self-Evolving Training for Multimodal Reasoning☆75Jul 13, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- a simple variational auto encoder with some exploration☆14Nov 22, 2024Updated last year
- Orthogonal Matching Pursuit, parallelized on both CPU and GPU. 100x+ Speedup☆18Updated this week
- Multipack distributed sampler for fast padding-free training of LLMs☆207Aug 10, 2024Updated 2 years ago
- ☆17Jun 22, 2025Updated last year
- Token-level adaptation of LoRA matrices for downstream task generalization.☆15Apr 14, 2024Updated 2 years ago
- ☆14Oct 31, 2023Updated 2 years ago
- ☆11Jul 6, 2023Updated 3 years ago
- VeLO optimizer in PyTorch☆20Feb 6, 2023Updated 3 years ago
- ☆166Aug 8, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆15Sep 23, 2026Updated 2 weeks ago
- This project generates a high-quality Alpaca-style dataset from input text files, PDFs, and Word documents.☆58Apr 7, 2026Updated 6 months ago
- Qt GUI for LLM assisted co-writing☆12Jul 28, 2024Updated 2 years ago
- Collections of RLxLM experiments using minimal codes☆14Feb 17, 2025Updated last year
- Official implementation of 'A Large-Scale Exploration of mu-Transfer' (CoRR 2024)☆32Jun 5, 2025Updated last year
- ☆29Jan 14, 2025Updated last year
- Create Vector Store from Scratch in pure Python.☆13Dec 15, 2023Updated 2 years ago