Alternatives and similar repositories for torchmx

Users that are interested in torchmx are comparing it to the libraries listed below

• ChengZhang-98 / llm-mixed-q
  Official implementation of EMNLP'23 paper "Revisiting Block-based Quantisation: What is Important for Sub-8-bit LLM Inference?"
  ☆23Updated last year
• Qualcomm-AI-research / FP8-quantization
  ☆158Updated 2 years ago
• SeoLabCornell / torch2chip
  Torch2Chip (MLSys, 2024)
  ☆53Updated 5 months ago
• snu-comparch / Tender
  Tender: Accelerating Large Language Models via Tensor Decompostion and Runtime Requantization (ISCA'24)
  ☆20Updated last year
• IntelLabs / FP8-Emulation-Toolkit
  PyTorch extension for emulating FP8 data formats on standard FP32 Xeon/GPU hardware.
  ☆110Updated 9 months ago
• naver-aics / lut-gemm
  ☆69Updated last year
• microsoft / microxcaling
  PyTorch emulation library for Microscaling (MX)-compatible data formats
  ☆288Updated 2 months ago
• union-codesign / union
  ☆14Updated 3 years ago
• cowanmeg / cgo-artifact-2020
  Artifact repository for paper Automatic Generation of High-Performance Quantized Machine Learning Kernels
  ☆17Updated 4 years ago
• clevercool / ANT-Quantization
  ☆107Updated last year
• ttambe / AdaptivFloat
  Adaptive floating-point based numerical format for resilient deep learning
  ☆14Updated 3 years ago
• jeffreyyu0602 / quantized-training
  ☆30Updated last week
• aojunzz / DominoSearch
  ☆19Updated 3 years ago
• sIncerass / QBERT
  ☆15Updated 2 years ago
• yifu-ding / BGEMM-CUDA
  This is a repository of Binary General Matrix Multiply (BGEMM) by customized CUDA kernel. Thank FP6-LLM for the wheels!
  ☆15Updated last year
• SamsungLabs / PMPD
  Codebase for the Progressive Mixed-Precision Decoding paper.
  ☆16Updated last month
• chenxm1986 / PIM-Toolchain
  EDA toolchain for processing-in-memory architectures, including an architecture synthesizer, a compiler, and a simulator
  ☆14Updated 2 months ago
• xvyaward / owq
  Code for the AAAI 2024 Oral paper "OWQ: Outlier-Aware Weight Quantization for Efficient Fine-Tuning and Inference of Large Language Model…
  ☆64Updated last year
• Accelergy-Project / pytorch2timeloop-converter
  ☆11Updated 10 months ago
• ma3mool / goldeneye
  GoldenEye is a functional simulator with fault injection capabilities for common and emerging numerical formats, implemented for the PyTo…
  ☆26Updated 10 months ago
• DD-DuDa / awesome-vit-quantization-acceleration
  List of papers related to Vision Transformers quantization and hardware acceleration in recent AI conferences and journals.
  ☆94Updated last year
• CASR-HKU / DPACS
  ☆18Updated 2 years ago
• ucb-bar / MoCA
  ☆28Updated 2 years ago
• GATECH-EIC / DNN-Chip-Predictor
  [ICASSP'20] DNN-Chip Predictor: An Analytical Performance Predictor for DNN Accelerators with Various Dataflows and Hardware Architecture…
  ☆25Updated 2 years ago
• maestro-project / frame
  FRAME: Fast Roofline Analytical Modeling and Estimation
  ☆37Updated last year
• nycu-caslab / TinyTS
  This is the open-source version of TinyTS. The code is dirty so far. We may clean the code in the future.
  ☆19Updated 3 weeks ago
• abdelfattah-lab / BitMoD-HPCA-25
  ☆49Updated last month
• ebby-s / MX-for-FPGA
  Implementation of Microscaling data formats in SystemVerilog.
  ☆23Updated last month
• Accelergy-Project / micro22-sparseloop-artifact
  MICRO22 artifact evaluation for Sparseloop
  ☆44Updated 3 years ago
• fastmachinelearning / qonnx
  QONNX: Arbitrary-Precision Quantized Neural Networks in ONNX
  ☆155Updated last month