Modeling code for a BitNet b1.58 Llama-style model.
☆25Apr 30, 2024Updated 2 years ago
Alternatives and similar repositories for bitnet
Users that are interested in bitnet are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- implementation of https://arxiv.org/pdf/2312.09299☆21Jul 3, 2024Updated 2 years ago
- QLoRA: Efficient Finetuning of Quantized LLMs☆11Jul 22, 2023Updated 3 years ago
- Implementation of BitNet-1.58 instruct tuning☆33Apr 14, 2024Updated 2 years ago
- This repository contains the code of our paper 'Skip \n: A simple method to reduce hallucination in Large Vision-Language Models'.☆15Feb 12, 2024Updated 2 years ago
- Set of scripts to finetune LLMs☆38Mar 30, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆13Jun 18, 2024Updated 2 years ago
- alternative way to calculating self attention☆18May 25, 2024Updated 2 years ago
- Unofficial implementations of block/layer-wise pruning methods for LLMs.☆78Apr 29, 2024Updated 2 years ago
- ☆13Apr 25, 2024Updated 2 years ago
- KANs and MLPs☆12Jun 7, 2024Updated 2 years ago
- A fully trainable state space model (SSM)☆16Mar 18, 2025Updated last year
- A video scene detection algorithm is designed to detect a variety of different scenes within a video. There is a very simple definition f…☆10Jan 4, 2022Updated 4 years ago
- Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.☆19Jul 24, 2025Updated last year
- Bullseye Polytope Clean-Label Poisoning Attack☆18Nov 5, 2020Updated 5 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Train to 94% on CIFAR-10 in 4.4 seconds on a single A100☆12Dec 30, 2023Updated 2 years ago
- Maximal Update Parametrization (μP) with Flax & Optax.☆16Dec 27, 2023Updated 2 years ago
- [COLM 2025] "C3PO: Critical-Layer, Core-Expert, Collaborative Pathway Optimization for Test-Time Expert Re-Mixing"☆21Apr 9, 2025Updated last year
- Matrix Product State algorithm for computing characters of the symmetric group S_n☆11Sep 26, 2025Updated 11 months ago
- Simple GRPO scripts and configurations.☆59Feb 6, 2025Updated last year
- An implementation of DecorrelatedBN by tensorflow☆13Jun 30, 2022Updated 4 years ago
- Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free☆234Oct 31, 2024Updated last year
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31May 22, 2024Updated 2 years ago
- ☆19Sep 2, 2026Updated 2 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- https://www.kaggle.com/c/siim-acr-pneumothorax-segmentation☆11Sep 11, 2019Updated 7 years ago
- Neural network density models for speech separation.☆20Nov 26, 2020Updated 5 years ago
- [ICML 2025] M-STAR (Multimodal Self-Evolving TrAining for Reasoning) Project. Diving into Self-Evolving Training for Multimodal Reasoning☆75Jul 13, 2025Updated last year
- Orthogonal Matching Pursuit, parallelized on both CPU and GPU. 100x+ Speedup☆17Apr 24, 2026Updated 4 months ago
- Multipack distributed sampler for fast padding-free training of LLMs☆207Aug 10, 2024Updated 2 years ago
- Implement reinforcement learning(RL) based on parameterized quantum circuits with quantum computing cloud Quafu.☆11Oct 19, 2023Updated 2 years ago
- ☆16Jun 22, 2025Updated last year
- Token-level adaptation of LoRA matrices for downstream task generalization.☆15Apr 14, 2024Updated 2 years ago
- ☆11Jul 6, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- manage histories of LLM applied applications☆91Nov 17, 2023Updated 2 years ago
- ☆166Aug 8, 2025Updated last year
- ☆15Updated this week
- Collections of RLxLM experiments using minimal codes☆14Feb 17, 2025Updated last year
- Train vision models using JAX and 🤗 transformers☆104Dec 14, 2025Updated 9 months ago
- 1.58-bit LLaMa model☆84Apr 3, 2024Updated 2 years ago
- Official implementation of 'A Large-Scale Exploration of mu-Transfer' (CoRR 2024)☆32Jun 5, 2025Updated last year