GreenWaves-Technologies / bfloat16Links
bfloat16 dtype for numpy
☆19Updated last year
Alternatives and similar repositories for bfloat16
Users that are interested in bfloat16 are comparing it to the libraries listed below
Sorting:
- PyTorch extension for emulating FP8 data formats on standard FP32 Xeon/GPU hardware.☆110Updated 9 months ago
- ☆159Updated last year
- QONNX: Arbitrary-Precision Quantized Neural Networks in ONNX☆155Updated last month
- ☆158Updated 2 years ago
- Customized matrix multiplication kernels☆56Updated 3 years ago
- Test suite for probing the numerical behavior of NVIDIA tensor cores☆41Updated last year
- benchmarking some transformer deployments☆26Updated 2 years ago
- Converting a deep neural network to integer-only inference in native C via uniform quantization and the fixed-point representation.☆25Updated 3 years ago
- Nod.ai 🦈 version of 👻 . You probably want to start at https://github.com/nod-ai/shark for the product and the upstream IREE repository …☆106Updated 7 months ago
- Prototype routines for GPU quantization written using PyTorch.☆21Updated last month
- Fast sparse deep learning on CPUs☆55Updated 2 years ago
- ☆74Updated 5 months ago
- A tiny FP8 multiplication unit written in Verilog. TinyTapeout 2 submission.☆14Updated 2 years ago
- Tool for the deployment and analysis of TinyML applications on TFLM and MicroTVM backends☆35Updated last week
- An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).☆261Updated last month
- The official, proof-of-concept C++ implementation of PocketNN.☆34Updated last year
- Tiny ASIC implementation for "The Era of 1-bit LLMs All Large Language Models are in 1.58 Bits" matrix multiplication unit☆159Updated last year
- ☆12Updated 4 years ago
- Repository for CPU Kernel Generation for LLM Inference☆26Updated 2 years ago
- An experimental CPU backend for Triton (https//github.com/openai/triton)☆45Updated 2 weeks ago
- GPTQ inference Triton kernel☆307Updated 2 years ago
- This is the open-source version of TinyTS. The code is dirty so far. We may clean the code in the future.☆19Updated 3 weeks ago
- This project contains a code generator that produces static C NN inference deployment code targeting tiny micro-controllers (TinyML) as r…☆30Updated 3 years ago
- A Python library transfers PyTorch tensors between CPU and NVMe☆120Updated 9 months ago
- Machine Learning Agility (MLAgility) benchmark and benchmarking tools☆39Updated last month
- ☆33Updated last year
- ☆72Updated 10 months ago
- A Data-Centric Compiler for Machine Learning☆84Updated last year
- A stand-alone implementation of several NumPy dtype extensions used in machine learning.☆293Updated 3 weeks ago
- Framework to reduce autotune overhead to zero for well known deployments.☆81Updated this week