VITA-Group / Q-Hitter

Related projects ⓘ

Alternatives and complementary repositories for Q-Hitter

• pku-liang / MAGIS
  MAGIS: Memory Optimization via Coordinated Graph Transformation and Scheduling for DNN (ASPLOS'24)
  ☆43Updated 5 months ago
• pku-liang / ArkVale
  ArkVale: Efficient Generative LLM Inference with Recallable Key-Value Eviction (NIPS'24)
  ☆16Updated 2 weeks ago
• DerrickYLJ / TidalDecode
  TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention
  ☆21Updated last month
• snu-comparch / Tender
  Tender: Accelerating Large Language Models via Tensor Decompostion and Runtime Requantization (ISCA'24)
  ☆12Updated 4 months ago
• uwsampl / sparsetir-artifact
  Repository for artifact evaluation of ASPLOS 2023 paper "SparseTIR: Composable Abstractions for Sparse Compilation in Deep Learning"
  ☆23Updated last year
• cornell-zhang / llm-datatypes
  Codebase for ICML'24 paper: Learning from Students: Applying t-Distributions to Explore Accurate and Efficient Formats for LLMs
  ☆24Updated 4 months ago
• BoyuanFeng / APNN-TC
  ☆17Updated 3 years ago
• abhibambhaniya / GenZ-LLM-Analyzer
  LLM Inference analyzer for different hardware platforms
  ☆42Updated this week
• hgyhungry / alcop-artifact
  ☆21Updated last year
• cat538 / SKVQ
  SKVQ: Sliding-window Key and Value Cache Quantization for Large Language Models
  ☆12Updated last month
• clevercool / ANT-Quantization
  ☆80Updated 11 months ago
• strongh2 / sc22-ae
  ☆12Updated 2 years ago
• naver-aics / lut-gemm
  ☆38Updated 7 months ago
• PrincetonUniversity / LLMCompass
  ☆83Updated 4 months ago
• hao-ai-lab / MuxServe
  ☆42Updated 4 months ago
• ScalingIntelligence / CATS
  ☆20Updated this week
• zyxxmu / cam
  Pytorch implementation of our paper accepted by ICML 2024 -- CaM: Cache Merging for Memory-efficient LLMs Inference
  ☆25Updated 4 months ago
• ucb-bar / MoCA
  ☆22Updated last year
• YukeWang96 / MGG_OSDI23
  Artifact for OSDI'23: MGG: Accelerating Graph Neural Networks with Fine-grained intra-kernel Communication-Computation Pipelining on Mult…
  ☆37Updated 7 months ago
• apuaaChen / EVT_AE
  Artifacts of EVT ASPLOS'24
  ☆15Updated 8 months ago
• Shigangli / Magicube
  Magicube is a high-performance library for quantized sparse matrix operations (SpMM and SDDMM) of deep learning on Tensor Cores.
  ☆81Updated last year
• TiledTensor / ThrillerFlow
  ThrillerFlow is a Dataflow Analysis and Codegen Framework written in Rust.
  ☆10Updated last month
• wimh966 / outlier_suppression
  The official PyTorch implementation of the NeurIPS2022 (spotlight) paper, Outlier Suppression: Pushing the Limit of Low-bit Transformer L…
  ☆46Updated 2 years ago
• AIS-SNU / Smart-Infinity
  [HPCA'24] Smart-Infinity: Fast Large Language Model Training using Near-Storage Processing on a Real System
  ☆34Updated 8 months ago
• snu-comparch / InfiniGen
  InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management (OSDI'24)
  ☆76Updated 4 months ago
• PingchengDong / GQA-LUT
  The official implementation of the DAC 2024 paper GQA-LUT
  ☆10Updated last month
• UofT-EcoSystem / DietCode
  DietCode Code Release
  ☆61Updated 2 years ago
• mit-han-lab / spatten
  [HPCA'21] SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruning
  ☆75Updated 2 months ago
• jeffreyyu0602 / quantized-training
  ☆20Updated last week
• AutonomicPerfectionist / PipeInfer
  PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation
  ☆11Updated 2 months ago