Alternatives and similar repositories for halutmatmul:

Users that are interested in halutmatmul are comparing it to the libraries listed below

• trevorpogue / algebraic-nnhw
  Algebraic enhancements for GEMM & AI accelerators
  ☆263Updated 3 weeks ago
• IST-DASLab / QUIK
  Repository for the QUIK project, enabling the use of 4bit kernels for generative inference - EMNLP 2024
  ☆175Updated 10 months ago
• salykova / sgemm.cu
  High-Performance SGEMM on CUDA devices
  ☆74Updated 3 weeks ago
• facebookresearch / loop_tool
  A thin, highly portable toolkit for efficiently compiling dense loop-based computation.
  ☆148Updated 2 years ago
• mlecauchois / micrograd-cuda
  ☆239Updated 11 months ago
• spcl / daceml
  A Data-Centric Compiler for Machine Learning
  ☆82Updated last year
• tzakharko / m4-sme-exploration
  Exploring the scalable matrix extension of the Apple M4 processor
  ☆164Updated 3 months ago
• joennlae / tensorli
  Absolute minimalistic implementation of a GPT-like transformer using only numpy (<650 lines).
  ☆250Updated last year
• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆215Updated 7 months ago
• IST-DASLab / qmoe
  Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".
  ☆265Updated last year
• turingmotors / swan
  This project aims to enable language model inference on FPGAs, supporting AI applications in edge devices and environments with limited r…
  ☆145Updated 9 months ago
• kuterd / nv_isa_solver
  Nvidia Instruction Set Specification Generator
  ☆243Updated 7 months ago
• Xilinx / llvm-aie
  Fork of LLVM to support AMD AIEngine processors
  ☆123Updated this week
• a1k0n / a1gpt
  throwaway GPT inference
  ☆140Updated 8 months ago
• samvher / bert-for-laptops
  A BERT that you can train on a (gaming) laptop.
  ☆210Updated last year
• ROCm / hipBLASLt
  hipBLASLt is a library that provides general matrix-matrix operations with a flexible API and extends functionalities beyond a traditiona…
  ☆79Updated this week
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆183Updated 11 months ago
• kir-gadjello / zipslicer
  A library for incremental loading of large PyTorch checkpoints
  ☆56Updated last year
• robjinman / richard
  Richard is gaining power
  ☆185Updated 2 months ago
• usefulsensors / qc_npu_benchmark
  Code sample showing how to run and benchmark models on Qualcomm's Window PCs
  ☆95Updated 4 months ago
• DiscoGrad / DiscoGrad
  DiscoGrad - automatically differentiate across conditional branches in C++ programs
  ☆203Updated 5 months ago
• HLSTransform / submission
  ☆82Updated last year
• AMD-AIG-AIMA / AMD-LLM
  ☆181Updated 5 months ago
• gpuocelot / gpuocelot
  GPUOcelot: A dynamic compilation framework for PTX
  ☆166Updated last week
• microsoft / BitBLAS
  BitBLAS is a library to support mixed-precision matrix multiplications, especially for quantized LLM deployment.
  ☆523Updated last week
• rejunity / tiny-asic-1_58bit-matrix-mul
  Tiny ASIC implementation for "The Era of 1-bit LLMs All Large Language Models are in 1.58 Bits" matrix multiplication unit
  ☆118Updated 10 months ago
• AMDResearch / Riallto
  The Riallto Open Source Project from AMD
  ☆71Updated 3 months ago
• hidet-org / hidet
  An open-source efficient deep learning framework/compiler, written in python.
  ☆681Updated last week
• HanGuo97 / flute
  Fast Matrix Multiplications for Lookup Table-Quantized LLMs
  ☆229Updated this week
• Futrell / ziplm
  ☆251Updated last year