Alternatives and similar repositories for halutmatmul

Users that are interested in halutmatmul are comparing it to the libraries listed below

• trevorpogue / algebraic-nnhw
  Algebraic enhancements for GEMM & AI accelerators
  ☆280Updated 7 months ago
• IST-DASLab / QUIK
  Repository for the QUIK project, enabling the use of 4bit kernels for generative inference - EMNLP 2024
  ☆182Updated last year
• turingmotors / swan
  This project aims to enable language model inference on FPGAs, supporting AI applications in edge devices and environments with limited r…
  ☆166Updated last year
• facebookresearch / loop_tool
  A thin, highly portable toolkit for efficiently compiling dense loop-based computation.
  ☆148Updated 2 years ago
• mlecauchois / micrograd-cuda
  ☆248Updated last year
• DiscoGrad / DiscoGrad
  DiscoGrad - automatically differentiate across conditional branches in C++ programs
  ☆206Updated last year
• salykova / sgemm.cu
  High-Performance SGEMM on CUDA devices
  ☆105Updated 8 months ago
• spcl / daceml
  A Data-Centric Compiler for Machine Learning
  ☆84Updated last year
• valine / training-hot-swap
  Pytorch script hot swap: Change code without unloading your LLM from VRAM
  ☆124Updated 5 months ago
• NVIDIA / tilus
  Tilus is a tile-level kernel programming language with explicit control over shared memory and registers.
  ☆369Updated last week
• rejunity / tiny-asic-1_58bit-matrix-mul
  Tiny ASIC implementation for "The Era of 1-bit LLMs All Large Language Models are in 1.58 Bits" matrix multiplication unit
  ☆162Updated last year
• tzakharko / m4-sme-exploration
  Exploring the scalable matrix extension of the Apple M4 processor
  ☆204Updated 11 months ago
• joennlae / tensorli
  Absolute minimalistic implementation of a GPT-like transformer using only numpy (<650 lines).
  ☆253Updated last year
• nirw4nna / dsc
  Tensor library & inference framework for machine learning
  ☆110Updated this week
• a1k0n / a1gpt
  throwaway GPT inference
  ☆140Updated last year
• geohot / tt-tiny
  tiny code to access tenstorrent blackhole
  ☆59Updated 4 months ago
• exo-lang / exo
  Exocompilation for productive programming of hardware accelerators
  ☆667Updated this week
• robjinman / richard
  Richard is gaining power
  ☆194Updated 3 months ago
• Foreseerr / TScale
  ☆196Updated 5 months ago
• CentML / DeepView.Profile
  🏙 Interactive performance profiling and debugging tool for PyTorch neural networks.
  ☆64Updated 8 months ago
• moonshine-ai / qc_npu_benchmark
  Code sample showing how to run and benchmark models on Qualcomm's Window PCs
  ☆101Updated last year
• AMDResearch / Riallto
  The Riallto Open Source Project from AMD
  ☆84Updated 5 months ago
• UCSBarchlab / OpenTPU
  A open source reimplementation of Google's Tensor Processing Unit (TPU).
  ☆706Updated 7 years ago
• mengwanguc / gpemu
  GPEmu, a GPU emulator for faster and cheaper prototyping and evaluation of deep learning system research
  ☆30Updated 10 months ago
• kir-gadjello / zipslicer
  A library for incremental loading of large PyTorch checkpoints
  ☆56Updated 2 years ago
• tensil-ai / tensil
  Open source machine learning accelerators
  ☆388Updated last year
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆192Updated last year
• Futrell / ziplm
  ☆254Updated 2 years ago
• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆223Updated last year
• samvher / bert-for-laptops
  A BERT that you can train on a (gaming) laptop.
  ☆209Updated 2 years ago