Alternatives and similar repositories for llm-datatypes:

Users that are interested in llm-datatypes are comparing it to the libraries listed below

• abdelfattah-lab / BitMoD-HPCA-25
  ☆17Updated last month
• sIncerass / QBERT
  ☆15Updated 2 years ago
• UCLA-VAST / Serpens
  Serpens is an HBM FPGA accelerator for SpMV
  ☆17Updated 6 months ago
• cornell-zhang / quickest
  QuickEst repository: Quick Estimation of Quality of Results
  ☆26Updated 6 years ago
• VITA-Group / Q-Hitter
  ☆11Updated 7 months ago
• clevercool / ANT-Quantization
  ☆90Updated last year
• ucb-bar / dosa
  DOSA: Differentiable Model-Based One-Loop Search for DNN Accelerators
  ☆13Updated 3 months ago
• DerrickYLJ / TidalDecode
  [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention
  ☆26Updated last month
• wimh966 / outlier_suppression
  The official PyTorch implementation of the NeurIPS2022 (spotlight) paper, Outlier Suppression: Pushing the Limit of Low-bit Transformer L…
  ☆47Updated 2 years ago
• aiha-lab / MX-QLLM
  LLM Inference with Microscaling Format
  ☆17Updated 2 months ago
• snu-comparch / Tender
  Tender: Accelerating Large Language Models via Tensor Decompostion and Runtime Requantization (ISCA'24)
  ☆13Updated 6 months ago
• naver-aics / lut-gemm
  ☆48Updated 9 months ago
• SeoLabCornell / torch2chip
  Torch2Chip (MLSys, 2024)
  ☆51Updated 2 weeks ago
• ChengZhang-98 / llm-mixed-q
  mixed-precision quantization for LLMs
  ☆19Updated last year
• mit-han-lab / spatten
  [HPCA'21] SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruning
  ☆81Updated 5 months ago
• UCLA-VAST / AutoDSE
  ACM TODAES Best Paper Award, 2022
  ☆24Updated last year
• xvyaward / owq
  Code for the AAAI 2024 Oral paper "OWQ: Outlier-Aware Weight Quantization for Efficient Fine-Tuning and Inference of Large Language Model…
  ☆56Updated 10 months ago
• uwsampl / sparsetir-artifact
  Repository for artifact evaluation of ASPLOS 2023 paper "SparseTIR: Composable Abstractions for Sparse Compilation in Deep Learning"
  ☆24Updated last year
• GATECH-EIC / Auto-NBA
  [ICML 2021] "Auto-NBA: Efficient and Effective Search Over the Joint Space of Networks, Bitwidths, and Accelerators" by Yonggan Fu, Yonga…
  ☆15Updated 3 years ago
• sharc-lab / GenGNN
  ☆36Updated 3 years ago
• cornell-zhang / GraphLily
  A graph linear algebra overlay
  ☆50Updated last year
• AIS-SNU / Smart-Infinity
  [HPCA'24] Smart-Infinity: Fast Large Language Model Training using Near-Storage Processing on a Real System
  ☆39Updated 10 months ago
• cornell-zhang / SPADE
  ☆11Updated 3 years ago
• AboveParadise / LLMCBench
  ☆19Updated last month
• upmem / upmem_llm_framework
  UPMEM LLM Framework allows profiling PyTorch layers and functions and simulate those layers/functions with a given hardware profile.
  ☆17Updated 2 months ago
• isakedo / DNNsim
  ☆32Updated 4 years ago
• cornell-zhang / GARNET
  GARNET: Reduced-Rank Topology Learning for Robust and Scalable Graph Neural Networks
  ☆35Updated last year
• linghaosong / Serpens
  An HBM FPGA based SpMV Accelerator
  ☆12Updated 5 months ago
• aojunzz / DominoSearch
  ☆18Updated 3 years ago
• cornell-zhang / HOGA
  Hop-Wise Graph Attention for Scalable and Generalizable Learning on Circuits
  ☆26Updated 5 months ago