Alternatives and similar repositories for bfloat16

Users that are interested in bfloat16 are comparing it to the libraries listed below

• Qualcomm-AI-research / FP8-quantization
  ☆168Updated 2 years ago
• fastmachinelearning / qonnx
  QONNX: Arbitrary-Precision Quantized Neural Networks in ONNX
  ☆168Updated last week
• jundaf2 / INT8-Flash-Attention-FMHA-Quantization
  ☆159Updated 2 years ago
• AndrewZhaoLuo / TVM-Sandbox
  Sandbox for TVM and playing around!
  ☆22Updated 3 years ago
• DeMoriarty / custom_matmul_kernels
  Customized matrix multiplication kernels
  ☆57Updated 3 years ago
• masahi / torchscript-to-tvm
  ☆68Updated 2 years ago
• benja263 / Integer-Only-Inference-for-Deep-Learning-in-Native-C
  Converting a deep neural network to integer-only inference in native C via uniform quantization and the fixed-point representation.
  ☆26Updated 3 years ago
• ucb-bar / onnxruntime-riscv
  Fork of upstream onnxruntime focused on supporting risc-v accelerators
  ☆88Updated 2 years ago
• marsupialtail / sparsednn
  Fast sparse deep learning on CPUs
  ☆56Updated 3 years ago
• hpcaitech / TensorNVMe
  A Python library transfers PyTorch tensors between CPU and NVMe
  ☆123Updated last year
• meta-pytorch / multipy
  torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…
  ☆182Updated this week
• facebookexperimental / protoquant
  Prototype routines for GPU quantization written using PyTorch.
  ☆21Updated 4 months ago
• meta-pytorch / triton-cpu
  An experimental CPU backend for Triton (https//github.com/openai/triton)
  ☆47Updated 4 months ago
• tum-ei-eda / utvm_staticrt_codegen
  This project contains a code generator that produces static C NN inference deployment code targeting tiny micro-controllers (TinyML) as r…
  ☆29Updated 4 years ago
• deepspeedai / DeepSpeed-Kernels
  ☆71Updated 8 months ago
• jax-ml / ml_dtypes
  A stand-alone implementation of several NumPy dtype extensions used in machine learning.
  ☆320Updated this week
• cchan / fp8_mul
  A tiny FP8 multiplication unit written in Verilog. TinyTapeout 2 submission.
  ☆14Updated 3 years ago
• tum-ei-eda / mlonmcu
  Tool for the deployment and analysis of TinyML applications on TFLM and MicroTVM backends
  ☆33Updated this week
• jaewoosong / pocketnn
  The official, proof-of-concept C++ implementation of PocketNN.
  ☆35Updated 2 months ago
• pulp-platform / quantlab
  ☆39Updated last year
• Harry-Chen / InfMoE
  Inference framework for MoE layers based on TensorRT with Python binding
  ☆41Updated 4 years ago
• zhenhuaw-me / tflite
  Parse TFLite models (*.tflite) EASILY with Python. Check the API at https://zhenhuaw.me/tflite/docs/
  ☆103Updated 10 months ago
• RaulMurillo / deep-pensieve
  A Deep Learning Framework for the Posit Number System
  ☆31Updated last year
• makslevental / nelli
  A lightweight, Pythonic, frontend for MLIR
  ☆80Updated 2 years ago
• WuDan0399 / Integrate-NVDLA-and-TVM
  ☆33Updated 2 years ago
• tlc-pack / TLCBench
  Benchmark scripts for TVM
  ☆74Updated 3 years ago
• jmluu / Awesome-Efficient-Training
  A collection of research papers on efficient training of DNNs
  ☆70Updated 3 years ago
• spcl / daceml
  A Data-Centric Compiler for Machine Learning
  ☆85Updated last week
• ruslangrimov / mnist-minimal-model
  Trying to find out what is the minimal model that can achieve 99% accuracy on MNIST dataset
  ☆28Updated 7 years ago
• usyd-fsalab / fp6_llm
  An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).
  ☆276Updated 5 months ago