Alternatives and similar repositories for halutmatmul

Users that are interested in halutmatmul are comparing it to the libraries listed below

• trevorpogue / algebraic-nnhw
  Algebraic enhancements for GEMM & AI accelerators
  ☆282Updated 9 months ago
• facebookresearch / loop_tool
  A thin, highly portable toolkit for efficiently compiling dense loop-based computation.
  ☆149Updated 2 years ago
• turingmotors / swan
  This project aims to enable language model inference on FPGAs, supporting AI applications in edge devices and environments with limited r…
  ☆169Updated last year
• IST-DASLab / QUIK
  Repository for the QUIK project, enabling the use of 4bit kernels for generative inference - EMNLP 2024
  ☆184Updated last year
• deepreinforce-ai / CUDA-L2
  CUDA-L2: Surpassing cuBLAS Performance for Matrix Multiplication through Reinforcement Learning
  ☆142Updated this week
• mlecauchois / micrograd-cuda
  ☆249Updated last year
• nirw4nna / dsc
  Tensor library & inference framework for machine learning
  ☆114Updated 2 months ago
• salykova / sgemm.cu
  High-Performance SGEMM on CUDA devices
  ☆113Updated 10 months ago
• spcl / daceml
  A Data-Centric Compiler for Machine Learning
  ☆85Updated last year
• DiscoGrad / DiscoGrad
  DiscoGrad - automatically differentiate across conditional branches in C++ programs
  ☆209Updated last year
• HazyResearch / HipKittens
  Fast and Furious AMD Kernels
  ☆309Updated last week
• a1k0n / a1gpt
  throwaway GPT inference
  ☆141Updated last year
• NVIDIA / tilus
  Tilus is a tile-level kernel programming language with explicit control over shared memory and registers.
  ☆408Updated this week
• tzakharko / m4-sme-exploration
  Exploring the scalable matrix extension of the Apple M4 processor
  ☆211Updated last year
• joennlae / tensorli
  Absolute minimalistic implementation of a GPT-like transformer using only numpy (<650 lines).
  ☆255Updated 2 years ago
• moonshine-ai / qc_npu_benchmark
  Code sample showing how to run and benchmark models on Qualcomm's Window PCs
  ☆104Updated last year
• valine / training-hot-swap
  Pytorch script hot swap: Change code without unloading your LLM from VRAM
  ☆125Updated 7 months ago
• UCSBarchlab / OpenTPU
  A open source reimplementation of Google's Tensor Processing Unit (TPU).
  ☆712Updated 8 years ago
• geohot / tt-tiny
  tiny code to access tenstorrent blackhole
  ☆61Updated 6 months ago
• tensil-ai / tensil
  Open source machine learning accelerators
  ☆392Updated last year
• rejunity / tiny-asic-1_58bit-matrix-mul
  Tiny ASIC implementation for "The Era of 1-bit LLMs All Large Language Models are in 1.58 Bits" matrix multiplication unit
  ☆171Updated last year
• Futrell / ziplm
  ☆254Updated 2 years ago
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆194Updated last year
• kir-gadjello / zipslicer
  A library for incremental loading of large PyTorch checkpoints
  ☆56Updated 2 years ago
• mengwanguc / gpemu
  GPEmu, a GPU emulator for faster and cheaper prototyping and evaluation of deep learning system research
  ☆34Updated last year
• AMDResearch / Riallto
  The Riallto Open Source Project from AMD
  ☆82Updated 7 months ago
• robjinman / richard
  Richard is gaining power
  ☆199Updated 5 months ago
• IST-DASLab / qmoe
  Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".
  ☆278Updated 2 years ago
• AMD-AGI / AMD-LLM
  ☆191Updated last year
• CentML / DeepView.Profile
  🏙 Interactive performance profiling and debugging tool for PyTorch neural networks.
  ☆64Updated 10 months ago