Alternatives and similar repositories for torchmx

Users that are interested in torchmx are comparing it to the libraries listed below

• ChengZhang-98 / llm-mixed-q
  Official implementation of EMNLP'23 paper "Revisiting Block-based Quantisation: What is Important for Sub-8-bit LLM Inference?"
  ☆24Updated 2 years ago
• SeoLabCornell / torch2chip
  Torch2Chip (MLSys, 2024)
  ☆55Updated 8 months ago
• Qualcomm-AI-research / FP8-quantization
  ☆167Updated 2 years ago
• snu-comparch / Tender
  Tender: Accelerating Large Language Models via Tensor Decompostion and Runtime Requantization (ISCA'24)
  ☆24Updated last year
• clevercool / ANT-Quantization
  ☆113Updated 2 years ago
• IntelLabs / FP8-Emulation-Toolkit
  PyTorch extension for emulating FP8 data formats on standard FP32 Xeon/GPU hardware.
  ☆112Updated last year
• DD-DuDa / awesome-vit-quantization-acceleration
  List of papers related to Vision Transformers quantization and hardware acceleration in recent AI conferences and journals.
  ☆97Updated last year
• microsoft / microxcaling
  PyTorch emulation library for Microscaling (MX)-compatible data formats
  ☆325Updated 5 months ago
• yifu-ding / BGEMM-CUDA
  This is a repository of Binary General Matrix Multiply (BGEMM) by customized CUDA kernel. Thank FP6-LLM for the wheels!
  ☆18Updated last year
• ttambe / AdaptivFloat
  Adaptive floating-point based numerical format for resilient deep learning
  ☆14Updated 3 years ago
• jeffreyyu0602 / quantized-training
  ☆33Updated last week
• ebby-s / MX-for-FPGA
  Implementation of Microscaling data formats in SystemVerilog.
  ☆28Updated 5 months ago
• naver-aics / lut-gemm
  ☆82Updated last year
• CLab-HKUST-GZ / micro58-axcore
  ☆28Updated last month
• cowanmeg / cgo-artifact-2020
  Artifact repository for paper Automatic Generation of High-Performance Quantized Machine Learning Kernels
  ☆17Updated 5 years ago
• parsa-epfl / quantization-sparsity-interplay
  This repo contains the code for studying the interplay between quantization and sparsity methods
  ☆24Updated 9 months ago
• yanghr / BSQ
  BSQ: Exploring Bit-Level Sparsity for Mixed-Precision Neural Network Quantization (ICLR 2021)
  ☆42Updated 4 years ago
• maestro-project / frame
  FRAME: Fast Roofline Analytical Modeling and Estimation
  ☆39Updated 2 years ago
• xvyaward / owq
  Code for the AAAI 2024 Oral paper "OWQ: Outlier-Aware Weight Quantization for Efficient Fine-Tuning and Inference of Large Language Model…
  ☆68Updated last year
• mit-han-lab / spatten
  [HPCA'21] SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruning
  ☆116Updated last year
• actlab-genesys / GeneSys
  An open-source parameterizable NPU generator with full-stack multi-target compilation stack for intelligent workloads.
  ☆69Updated 2 months ago
• maestro-project / AIrchitect-v2
  [DATE 2025] Official implementation and dataset of AIrchitect v2: Learning the Hardware Accelerator Design Space through Unified Represen…
  ☆18Updated 11 months ago
• SamsungLabs / PMPD
  Codebase for the Progressive Mixed-Precision Decoding paper.
  ☆18Updated 5 months ago
• chenxm1986 / PIM-Toolchain
  EDA toolchain for processing-in-memory architectures, including an architecture synthesizer, a compiler, and a simulator
  ☆14Updated 6 months ago
• aojunzz / DominoSearch
  ☆19Updated 4 years ago
• GATECH-EIC / DNN-Chip-Predictor
  [ICASSP'20] DNN-Chip Predictor: An Analytical Performance Predictor for DNN Accelerators with Various Dataflows and Hardware Architecture…
  ☆25Updated 3 years ago
• hsharma35 / bitfusion
  Simulator for BitFusion
  ☆102Updated 5 years ago
• union-codesign / union
  ☆14Updated 4 years ago
• wimh966 / outlier_suppression
  The official PyTorch implementation of the NeurIPS2022 (spotlight) paper, Outlier Suppression: Pushing the Limit of Low-bit Transformer L…
  ☆49Updated 3 years ago
• DeepWok / mase
  Machine-Learning Accelerator System Exploration Tools
  ☆183Updated last week