joennlae / halutmatmulLinks
Hashed Lookup Table based Matrix Multiplication (halutmatmul) - Stella Nera accelerator
☆210Updated last year
Alternatives and similar repositories for halutmatmul
Users that are interested in halutmatmul are comparing it to the libraries listed below
Sorting:
- Algebraic enhancements for GEMM & AI accelerators☆276Updated 3 months ago
- ☆243Updated last year
- High-Performance SGEMM on CUDA devices☆94Updated 4 months ago
- A thin, highly portable toolkit for efficiently compiling dense loop-based computation.☆148Updated 2 years ago
- Absolute minimalistic implementation of a GPT-like transformer using only numpy (<650 lines).☆251Updated last year
- Repository for the QUIK project, enabling the use of 4bit kernels for generative inference - EMNLP 2024☆182Updated last year
- This project aims to enable language model inference on FPGAs, supporting AI applications in edge devices and environments with limited r…☆156Updated last year
- A BERT that you can train on a (gaming) laptop.☆207Updated last year
- Code sample showing how to run and benchmark models on Qualcomm's Window PCs☆97Updated 8 months ago
- Pytorch script hot swap: Change code without unloading your LLM from VRAM☆126Updated last month
- Exploring the scalable matrix extension of the Apple M4 processor☆176Updated 6 months ago
- A Data-Centric Compiler for Machine Learning☆83Updated last year
- DiscoGrad - automatically differentiate across conditional branches in C++ programs☆202Updated 8 months ago
- Tiny ASIC implementation for "The Era of 1-bit LLMs All Large Language Models are in 1.58 Bits" matrix multiplication unit☆150Updated last year
- Nvidia Instruction Set Specification Generator☆271Updated 10 months ago
- Code implementing "Efficient Parallelization of a Ubiquitious Sequential Computation" (Heinsen, 2023)☆94Updated 5 months ago
- An implementation of bucketMul LLM inference☆217Updated 11 months ago
- ☆310Updated last week
- A stand-alone implementation of several NumPy dtype extensions used in machine learning.☆268Updated this week
- Inference of Mamba models in pure C☆186Updated last year
- ☆192Updated 3 weeks ago
- A copy of ONNX models, datasets, and code all in one GitHub repository. Follow the README to learn more.☆105Updated last year
- Heirarchical Navigable Small Worlds☆96Updated last month
- A tool to analyze and debug neural networks in pytorch. Use a GUI to traverse the computation graph and view the data from many different…☆287Updated 5 months ago
- ctypes wrappers for HIP, CUDA, and OpenCL☆129Updated 11 months ago
- A description of Minotaur can be found in https://arxiv.org/abs/2306.00229.☆105Updated 10 months ago
- throwaway GPT inference☆139Updated last year
- High-Performance Klong array language in Python.☆299Updated this week
- The Finite Field Assembly Programming Language☆37Updated 2 weeks ago
- ☆252Updated last year