joennlae / halutmatmulLinks
Hashed Lookup Table based Matrix Multiplication (halutmatmul) - Stella Nera accelerator
☆211Updated last year
Alternatives and similar repositories for halutmatmul
Users that are interested in halutmatmul are comparing it to the libraries listed below
Sorting:
- Algebraic enhancements for GEMM & AI accelerators☆277Updated 4 months ago
- Repository for the QUIK project, enabling the use of 4bit kernels for generative inference - EMNLP 2024☆180Updated last year
- A thin, highly portable toolkit for efficiently compiling dense loop-based computation.☆149Updated 2 years ago
- ☆248Updated last year
- DiscoGrad - automatically differentiate across conditional branches in C++ programs☆203Updated 10 months ago
- This project aims to enable language model inference on FPGAs, supporting AI applications in edge devices and environments with limited r…☆162Updated last year
- Pytorch script hot swap: Change code without unloading your LLM from VRAM☆126Updated 2 months ago
- A Data-Centric Compiler for Machine Learning☆84Updated last year
- Tensor library & inference framework for machine learning☆101Updated last week
- Absolute minimalistic implementation of a GPT-like transformer using only numpy (<650 lines).☆252Updated last year
- High-Performance SGEMM on CUDA devices☆97Updated 5 months ago
- throwaway GPT inference☆140Updated last year
- Code sample showing how to run and benchmark models on Qualcomm's Window PCs☆100Updated 9 months ago
- Exocompilation for productive programming of hardware accelerators☆640Updated this week
- ☆196Updated 2 months ago
- A library for incremental loading of large PyTorch checkpoints☆56Updated 2 years ago
- Open source machine learning accelerators☆382Updated last year
- ☆188Updated 10 months ago
- Exploring the scalable matrix extension of the Apple M4 processor☆184Updated 8 months ago
- A open source reimplementation of Google's Tensor Processing Unit (TPU).☆676Updated 7 years ago
- Tiny ASIC implementation for "The Era of 1-bit LLMs All Large Language Models are in 1.58 Bits" matrix multiplication unit☆157Updated last year
- 🏙 Interactive performance profiling and debugging tool for PyTorch neural networks.☆62Updated 5 months ago
- Richard is gaining power☆192Updated 3 weeks ago
- The Finite Field Assembly Programming Language☆36Updated last month
- Heirarchical Navigable Small Worlds☆97Updated 3 months ago
- Nod.ai 🦈 version of 👻 . You probably want to start at https://github.com/nod-ai/shark for the product and the upstream IREE repository …☆106Updated 6 months ago
- Nvidia Instruction Set Specification Generator☆280Updated last year
- Samples of good AI generated CUDA kernels☆84Updated last month
- Inference of Mamba models in pure C☆188Updated last year
- ☆134Updated 2 years ago