Alternatives and similar repositories for halutmatmul

Users that are interested in halutmatmul are comparing it to the libraries listed below

• trevorpogue / algebraic-nnhw
  Algebraic enhancements for GEMM & AI accelerators
  ☆276Updated 3 months ago
• mlecauchois / micrograd-cuda
  ☆243Updated last year
• salykova / sgemm.cu
  High-Performance SGEMM on CUDA devices
  ☆94Updated 4 months ago
• facebookresearch / loop_tool
  A thin, highly portable toolkit for efficiently compiling dense loop-based computation.
  ☆148Updated 2 years ago
• joennlae / tensorli
  Absolute minimalistic implementation of a GPT-like transformer using only numpy (<650 lines).
  ☆251Updated last year
• IST-DASLab / QUIK
  Repository for the QUIK project, enabling the use of 4bit kernels for generative inference - EMNLP 2024
  ☆182Updated last year
• turingmotors / swan
  This project aims to enable language model inference on FPGAs, supporting AI applications in edge devices and environments with limited r…
  ☆156Updated last year
• samvher / bert-for-laptops
  A BERT that you can train on a (gaming) laptop.
  ☆207Updated last year
• usefulsensors / qc_npu_benchmark
  Code sample showing how to run and benchmark models on Qualcomm's Window PCs
  ☆97Updated 8 months ago
• valine / training-hot-swap
  Pytorch script hot swap: Change code without unloading your LLM from VRAM
  ☆126Updated last month
• tzakharko / m4-sme-exploration
  Exploring the scalable matrix extension of the Apple M4 processor
  ☆176Updated 6 months ago
• spcl / daceml
  A Data-Centric Compiler for Machine Learning
  ☆83Updated last year
• DiscoGrad / DiscoGrad
  DiscoGrad - automatically differentiate across conditional branches in C++ programs
  ☆202Updated 8 months ago
• rejunity / tiny-asic-1_58bit-matrix-mul
  Tiny ASIC implementation for "The Era of 1-bit LLMs All Large Language Models are in 1.58 Bits" matrix multiplication unit
  ☆150Updated last year
• kuterd / nv_isa_solver
  Nvidia Instruction Set Specification Generator
  ☆271Updated 10 months ago
• glassroom / heinsen_sequence
  Code implementing "Efficient Parallelization of a Ubiquitious Sequential Computation" (Heinsen, 2023)
  ☆94Updated 5 months ago
• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆217Updated 11 months ago
• google / aqt
  ☆310Updated last week
• jax-ml / ml_dtypes
  A stand-alone implementation of several NumPy dtype extensions used in machine learning.
  ☆268Updated this week
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆186Updated last year
• Foreseerr / TScale
  ☆192Updated 3 weeks ago
• xetdata / onnx-models
  A copy of ONNX models, datasets, and code all in one GitHub repository. Follow the README to learn more.
  ☆105Updated last year
• dicroce / hnsw
  Heirarchical Navigable Small Worlds
  ☆96Updated last month
• FlorianDietz / comgra
  A tool to analyze and debug neural networks in pytorch. Use a GUI to traverse the computation graph and view the data from many different…
  ☆287Updated 5 months ago
• tinygrad / gpuctypes
  ctypes wrappers for HIP, CUDA, and OpenCL
  ☆129Updated 11 months ago
• minotaur-toolkit / minotaur
  A description of Minotaur can be found in https://arxiv.org/abs/2306.00229.
  ☆105Updated 10 months ago
• a1k0n / a1gpt
  throwaway GPT inference
  ☆139Updated last year
• briangu / klongpy
  High-Performance Klong array language in Python.
  ☆299Updated this week
• LeetArxiv / Finite-Field-Assembly
  The Finite Field Assembly Programming Language
  ☆37Updated 2 weeks ago
• Futrell / ziplm
  ☆252Updated last year