Alternatives and similar repositories for pytorch-nncp:

Users that are interested in pytorch-nncp are comparing it to the libraries listed below

• mynotwo / A-Fast-Transformer-based-General-Purpose-LosslessCompressor
  This repository contains the source code and dataset link mentioned in WWW 2022 accepted paper "TRACE:A Fast Transformer-based General-Pu…
  ☆28Updated 3 years ago
• erika-n / GPTzip
  An implementation of LLMzip using GPT-2
  ☆12Updated last year
• vcskaushik / LLMzip
  ☆46Updated last month
• kaitz / fx2-cmix
  Hutter Prize Submission
  ☆21Updated 4 months ago
• IST-DASLab / QIGen
  Repository for CPU Kernel Generation for LLM Inference
  ☆25Updated last year
• chu-tianxiang / QuIP-for-all
  QuIP quantization
  ☆50Updated 11 months ago
• pan-x-c / EE-LLM
  EE-LLM is a framework for large-scale training and inference of early-exit (EE) large language models (LLMs).
  ☆53Updated 8 months ago
• InterDigitalInc / CompressAI-Vision
  CompressAI-Vision helps you design, test and compare Video Compression for Machines pipelines. Compression methods can be either pulled f…
  ☆88Updated this week
• Cornell-RelaxML / qtip
  ☆107Updated last month
• MDK8888 / vllmini
  A minimal implementation of vllm.
  ☆33Updated 6 months ago
• graphcore-research / out-of-the-box-fp8-training
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆43Updated 7 months ago
• kyegomez / Blockwise-Parallel-Transformer
  32 times longer context window than vanilla Transformers and up to 4 times longer than memory efficient Transformers.
  ☆45Updated last year
• Nota-NetsPresso / shortened-llm
  Compressed LLMs for Efficient Text Generation [ICLR'24 Workshop]
  ☆71Updated 5 months ago
• thu-ml / low-bit-optimizers
  Low-bit optimizers for PyTorch
  ☆125Updated last year
• hwang595 / Cuttlefish
  The implementation for MLSys 2023 paper: "Cuttlefish: Low-rank Model Training without All The Tuning"
  ☆43Updated last year
• kyegomez / FlashAttention20
  Get down and dirty with FlashAttention2.0 in pytorch, plug in and play no complex CUDA kernels
  ☆102Updated last year
• epfml / dynamic-sparse-flash-attention
  ☆138Updated last year
• shreyansh26 / Speculative-Sampling
  Implementation of Speculative Sampling as described in "Accelerating Large Language Model Decoding with Speculative Sampling" by Deepmind
  ☆87Updated 11 months ago
• NolanoOrg / sparse_quant_llms
  SparseGPT + GPTQ Compression of LLMs like LLaMa, OPT, Pythia
  ☆41Updated last year
• liyucheng09 / llm-compressive
  Longitudinal Evaluation of LLMs via Data Compression
  ☆31Updated 8 months ago
• kyegomez / SparseAttention
  Pytorch Implementation of the sparse attention from the paper: "Generating Long Sequences with Sparse Transformers"
  ☆71Updated 3 weeks ago
• wdlctc / mini-s
  ☆44Updated 3 months ago
• syncdoth / RetNet
  Huggingface compatible implementation of RetNet (Retentive Networks, https://arxiv.org/pdf/2307.08621.pdf) including parallel, recurrent,…
  ☆225Updated 11 months ago
• DS3Lab / DT-FM
  ☆92Updated 2 years ago
• Infini-AI-Lab / MagicDec
  [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding
  ☆107Updated 2 months ago
• TsinghuaC3I / Fourier-Position-Embedding
  Fourier Position Embedding: Enhancing Attention’s Periodic Extension for Length Generalization
  ☆13Updated last month
• opengear-project / GEAR
  GEAR: An Efficient KV Cache Compression Recipefor Near-Lossless Generative Inference of LLM
  ☆157Updated 7 months ago
• IsaacRe / vllm-kvcompress
  KV cache compression for high-throughput LLM inference
  ☆115Updated 2 weeks ago
• BlinkDL / LM-Trick-Questions
  Here we collect trick questions and failed tasks for open source LLMs to improve them.
  ☆32Updated last year