Alternatives and similar repositories for LLMzip

Users that are interested in LLMzip are comparing it to the libraries listed below

• google-deepmind / language_modeling_is_compression
  ☆137Updated 9 months ago
• NolanoOrg / SpectraSuite
  ☆48Updated 10 months ago
• siyan-zhao / prepacking
  The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …
  ☆59Updated 7 months ago
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆36Updated last year
• chu-tianxiang / QuIP-for-all
  QuIP quantization
  ☆52Updated last year
• erika-n / GPTzip
  An implementation of LLMzip using GPT-2
  ☆12Updated last year
• RobertCsordas / moeut
  ☆79Updated 9 months ago
• kyleliang919 / Online-Subspace-Descent
  This repo is based on https://github.com/jiaweizzhao/GaLore
  ☆28Updated 8 months ago
• wdlctc / mini-s
  ☆50Updated 7 months ago
• ScalingIntelligence / large_language_monkeys
  ☆93Updated 8 months ago
• VITA-Group / WeLore
  From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients. Ajay Jaiswal, Lu Yin, Zhenyu Zhang, Shiwei Liu,…
  ☆47Updated last month
• hahnyuan / PB-LLM
  PB-LLM: Partially Binarized Large Language Models
  ☆152Updated last year
• google-deepmind / asyncdiloco
  ☆44Updated last year
• Oxen-AI / mamba-dive
  This is the code that went into our practical dive using mamba as information extraction
  ☆53Updated last year
• minyoungg / LTE
  ☆68Updated 10 months ago
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆37Updated last year
• hkust-nlp / llm-compression-intelligence
  Official github repo for the paper "Compression Represents Intelligence Linearly" [COLM 2024]
  ☆136Updated 8 months ago
• BlinkDL / LinearAttentionArena
  Here we will test various linear attention designs.
  ☆58Updated last year
• IST-DASLab / MicroAdam
  This repository contains code for the MicroAdam paper.
  ☆19Updated 5 months ago
• kyegomez / OpenStrawberry
  An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO
  ☆29Updated last week
• lucidrains / PEER-pytorch
  Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind
  ☆126Updated 9 months ago
• JacobPfau / fillerTokens
  ☆61Updated last year
• IST-DASLab / QuEST
  Work in progress.
  ☆67Updated last week
• tyler-romero / microR1
  Simple repository for training small reasoning models
  ☆31Updated 4 months ago
• FasterDecoding / BitDelta
  ☆197Updated 6 months ago
• HanGuo97 / lq-lora
  ☆125Updated last year
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆88Updated 6 months ago
• amudide / switch_sae
  Efficient Dictionary Learning with Switch Sparse Autoencoders (SAEs)
  ☆23Updated 6 months ago
• scottlogic-alex / prm800k-denorm
  Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format
  ☆27Updated last year
• tanyuqian / redco
  NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference
  ☆66Updated 5 months ago