Alternatives and similar repositories for pytorch-nncp:

Users that are interested in pytorch-nncp are comparing it to the libraries listed below

• mohit1997 / Dzip-torch
  Dzip: improved general-purpose lossless compression based on novel neural network modeling
  ☆70Updated 3 years ago
• mynotwo / A-Fast-Transformer-based-General-Purpose-LosslessCompressor
  This repository contains the source code and dataset link mentioned in WWW 2022 accepted paper "TRACE:A Fast Transformer-based General-Pu…
  ☆28Updated 3 years ago
• erika-n / GPTzip
  An implementation of LLMzip using GPT-2
  ☆12Updated last year
• vcskaushik / LLMzip
  ☆50Updated 3 months ago
• kaitz / fx2-cmix
  Hutter Prize Submission
  ☆26Updated 6 months ago
• 3outeille / GPTQ-for-RWKV
  ☆13Updated last year
• byronknoll / cmix-hp
  Hutter Prize Submission
  ☆14Updated 3 years ago
• chu-tianxiang / QuIP-for-all
  QuIP quantization
  ☆51Updated last year
• IST-DASLab / QIGen
  Repository for CPU Kernel Generation for LLM Inference
  ☆26Updated last year
• fraunhoferhhi / nncodec
  Fraunhofer Neural Network Encoder/Decoder (NNCodec)
  ☆77Updated last year
• SqueezeAILab / KVQuant
  [NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization
  ☆340Updated 8 months ago
• google-deepmind / language_modeling_is_compression
  ☆132Updated 7 months ago
• efeslab / fiddler
  [ICLR'25] Fast Inference of MoE Models with CPU-GPU Orchestration
  ☆208Updated 5 months ago
• yxli2123 / LoftQ
  ☆219Updated 10 months ago
• AlpinDale / QuIP-for-Llama
  Code for paper: "QuIP: 2-Bit Quantization of Large Language Models With Guarantees" adapted for Llama models
  ☆35Updated last year
• lucidrains / speculative-decoding
  Explorations into some recent techniques surrounding speculative decoding
  ☆259Updated 4 months ago
• thu-ml / low-bit-optimizers
  Low-bit optimizers for PyTorch
  ☆128Updated last year
• BlinkDL / LinearAttentionArena
  Here we will test various linear attention designs.
  ☆60Updated last year
• hwang595 / Cuttlefish
  The implementation for MLSys 2023 paper: "Cuttlefish: Low-rank Model Training without All The Tuning"
  ☆44Updated last year
• kyegomez / Blockwise-Parallel-Transformer
  32 times longer context window than vanilla Transformers and up to 4 times longer than memory efficient Transformers.
  ☆47Updated last year
• Cornell-RelaxML / QuIP
  Code for paper: "QuIP: 2-Bit Quantization of Large Language Models With Guarantees"
  ☆363Updated last year
• kst179 / fused-attention
  Fast and low-memory attention layer written in CUDA
  ☆17Updated last year
• lucidrains / PEER-pytorch
  Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind
  ☆123Updated 8 months ago
• Cornell-RelaxML / qtip
  ☆126Updated last month
• OpenNLPLab / Tnn
  [ICLR 2023] Official implementation of Transnormer in our ICLR 2023 paper - Toeplitz Neural Network for Sequence Modeling
  ☆79Updated last year
• opengear-project / GEAR
  GEAR: An Efficient KV Cache Compression Recipefor Near-Lossless Generative Inference of LLM
  ☆159Updated 9 months ago
• WooSunghyeon / dropbp
  The official code for Dropping Backward Propagation (DropBP)
  ☆30Updated 5 months ago
• erogol / BlaGPT
  Experimental playground for benchmarking language model (LM) architectures, layers, and tricks on smaller datasets. Designed for flexible…
  ☆25Updated 3 weeks ago
• Dao-AILab / fast-hadamard-transform
  Fast Hadamard transform in CUDA, with a PyTorch interface
  ☆174Updated 11 months ago
• pytorch-labs / superblock
  A block oriented training approach for inference time optimization.
  ☆32Updated 8 months ago