joennlae / halutmatmulLinks
Hashed Lookup Table based Matrix Multiplication (halutmatmul) - Stella Nera accelerator
☆211Updated last year
Alternatives and similar repositories for halutmatmul
Users that are interested in halutmatmul are comparing it to the libraries listed below
Sorting:
- Algebraic enhancements for GEMM & AI accelerators☆277Updated 3 months ago
- Repository for the QUIK project, enabling the use of 4bit kernels for generative inference - EMNLP 2024☆180Updated last year
- A thin, highly portable toolkit for efficiently compiling dense loop-based computation.☆148Updated 2 years ago
- ☆248Updated last year
- High-Performance SGEMM on CUDA devices☆95Updated 5 months ago
- A Data-Centric Compiler for Machine Learning☆84Updated last year
- Pytorch script hot swap: Change code without unloading your LLM from VRAM☆126Updated 2 months ago
- An implementation of bucketMul LLM inference☆217Updated 11 months ago
- This project aims to enable language model inference on FPGAs, supporting AI applications in edge devices and environments with limited r…☆162Updated last year
- Exploring the scalable matrix extension of the Apple M4 processor☆178Updated 7 months ago
- Absolute minimalistic implementation of a GPT-like transformer using only numpy (<650 lines).☆252Updated last year
- ☆196Updated last month
- Fork of LLVM to support AMD AIEngine processors☆145Updated this week
- Code implementing "Efficient Parallelization of a Ubiquitious Sequential Computation" (Heinsen, 2023)☆94Updated 6 months ago
- A stand-alone implementation of several NumPy dtype extensions used in machine learning.☆273Updated 3 weeks ago
- ☆340Updated this week
- Nvidia Instruction Set Specification Generator☆278Updated 11 months ago
- throwaway GPT inference☆140Updated last year
- Tensor library & inference framework for machine learning☆77Updated last week
- Tiny ASIC implementation for "The Era of 1-bit LLMs All Large Language Models are in 1.58 Bits" matrix multiplication unit☆155Updated last year
- The Riallto Open Source Project from AMD☆80Updated 2 months ago
- A description of Minotaur can be found in https://arxiv.org/abs/2306.00229.☆108Updated 10 months ago
- Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".☆277Updated last year
- A open source reimplementation of Google's Tensor Processing Unit (TPU).☆664Updated 7 years ago
- DiscoGrad - automatically differentiate across conditional branches in C++ programs☆203Updated 9 months ago
- Samples of good AI generated CUDA kernels☆83Updated 3 weeks ago
- ☆94Updated last year
- Sequential Logic☆111Updated this week
- A tool to analyze and debug neural networks in pytorch. Use a GUI to traverse the computation graph and view the data from many different…☆287Updated 6 months ago
- Code sample showing how to run and benchmark models on Qualcomm's Window PCs☆99Updated 8 months ago