Alternatives and similar repositories for bitnet_cpu

Users that are interested in bitnet_cpu are comparing it to the libraries listed below

• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆55Updated last year
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆92Updated 7 months ago
• BlinkDL / fast.c
  Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.
  ☆72Updated 5 months ago
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆188Updated last year
• GreenBitAI / low_bit_llama
  Advanced Ultra-Low Bitrate Compression Techniques for the LLaMA Family of LLMs
  ☆110Updated last year
• ngxson / ggml-easy
  Thin wrapper around GGML to make life easier
  ☆36Updated 3 weeks ago
• cahya-wirawan / rwkv-tokenizer
  A fast RWKV Tokenizer written in Rust
  ☆46Updated this week
• lukasVierling / FaceRWKV
  Course Project for COMP4471 on RWKV
  ☆17Updated last year
• chu-tianxiang / QuIP-for-all
  QuIP quantization
  ☆54Updated last year
• NolanoOrg / SpectraSuite
  ☆49Updated 11 months ago
• pranavjad / tinyllama-bitnet
  Train your own small bitnet model
  ☆74Updated 8 months ago
• kyegomez / OpenStrawberry
  An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO
  ☆29Updated last week
• euclaise / supertrainer2000
  ☆49Updated last year
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆81Updated last month
• BlinkDL / nanoRWKV
  RWKV in nanoGPT style
  ☆191Updated last year
• nivibilla / build-nanogpt
  Video+code lecture on building nanoGPT from scratch
  ☆69Updated last year
• xaedes / llama.cpp
  Port of Facebook's LLaMA model in C/C++
  ☆22Updated last year
• facebookresearch / fastgen
  Simple high-throughput inference library
  ☆120Updated 2 months ago
• vcskaushik / LLMzip
  ☆56Updated 6 months ago
• AlpinDale / QuIP-for-Llama
  Code for paper: "QuIP: 2-Bit Quantization of Large Language Models With Guarantees" adapted for Llama models
  ☆38Updated last year
• abetlen / ggml-python
  Python bindings for ggml
  ☆142Updated 10 months ago
• fairydreaming / farel-bench
  Testing LLM reasoning abilities with family relationship quizzes.
  ☆62Updated 5 months ago
• 99991 / pygguf
  GGUF parser in Python
  ☆28Updated 11 months ago
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆85Updated 2 months ago
• LegallyCoder / mamba-hf
  Implementation of the Mamba SSM with hf_integration.
  ☆56Updated 10 months ago
• reka-ai / rekaquant
  ☆49Updated this week
• apehex / tokun
  Tokun to can tokens
  ☆18Updated 3 weeks ago
• wozeparrot / tinyrwkv
  tinygrad port of the RWKV large language model.
  ☆45Updated 4 months ago
• austinsilveria / tricksy
  Fast approximate inference on a single GPU with sparsity aware offloading
  ☆38Updated last year
• catid / lllm
  Latent Large Language Models
  ☆18Updated 10 months ago