Alternatives and similar repositories for bfloat16

Users that are interested in bfloat16 are comparing it to the libraries listed below

• fastmachinelearning / qonnx
  QONNX: Arbitrary-Precision Quantized Neural Networks in ONNX
  ☆175Updated this week
• cchan / fp8_mul
  A tiny FP8 multiplication unit written in Verilog. TinyTapeout 2 submission.
  ☆14Updated 3 years ago
• Qualcomm-AI-research / FP8-quantization
  ☆169Updated 2 years ago
• jundaf2 / INT8-Flash-Attention-FMHA-Quantization
  ☆160Updated 2 years ago
• AMDResearch / Riallto
  The Riallto Open Source Project from AMD
  ☆84Updated 10 months ago
• RaulMurillo / deep-pensieve
  A Deep Learning Framework for the Posit Number System
  ☆31Updated last year
• SeoLabCornell / torch2chip
  Torch2Chip (MLSys, 2024)
  ☆55Updated 10 months ago
• DeMoriarty / custom_matmul_kernels
  Customized matrix multiplication kernels
  ☆57Updated 3 years ago
• nod-ai / SRT
  Nod.ai 🦈 version of 👻 . You probably want to start at https://github.com/nod-ai/shark for the product and the upstream IREE repository …
  ☆107Updated last month
• jaewoosong / pocketnn
  The official, proof-of-concept C++ implementation of PocketNN.
  ☆36Updated 4 months ago
• CAS-CLab / BlockConv
  [TCAD 2021] Block Convolution: Towards Memory-Efficient Inference of Large-Scale CNNs on FPGA
  ☆17Updated 3 years ago
• tum-ei-eda / utvm_staticrt_codegen
  This project contains a code generator that produces static C NN inference deployment code targeting tiny micro-controllers (TinyML) as r…
  ☆30Updated 4 years ago
• ucb-bar / onnxruntime-riscv
  Fork of upstream onnxruntime focused on supporting risc-v accelerators
  ☆88Updated 2 years ago
• pulp-platform / quantlab
  ☆40Updated last year
• AndrewZhaoLuo / TVM-Sandbox
  Sandbox for TVM and playing around!
  ☆22Updated 3 years ago
• masahi / torchscript-to-tvm
  ☆68Updated 2 years ago
• Hahn-Schickard / Automatic-Structured-Pruning
  We have implemented a framework that supports developers to structured prune neural networks of Tensorflow Models
  ☆28Updated last year
• pulp-platform / chimera
  ☆19Updated 2 months ago
• meta-pytorch / multipy
  torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…
  ☆182Updated last month
• yuzhenmao / IceFormer
  Implementation of IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUs (ICLR 2024).
  ☆25Updated 6 months ago
• gau-nernst / quantized-training
  Explore training for quantized models
  ☆26Updated 6 months ago
• rejunity / tiny-asic-1_58bit-matrix-mul
  Tiny ASIC implementation for "The Era of 1-bit LLMs All Large Language Models are in 1.58 Bits" matrix multiplication unit
  ☆175Updated last year
• benja263 / Integer-Only-Inference-for-Deep-Learning-in-Native-C
  Converting a deep neural network to integer-only inference in native C via uniform quantization and the fixed-point representation.
  ☆25Updated 4 years ago
• hpcaitech / TensorNVMe
  A Python library transfers PyTorch tensors between CPU and NVMe
  ☆125Updated last year
• Qualcomm-AI-research / gptvq
  ☆40Updated last year
• brightlaboratory / polydl
  ☆11Updated 4 years ago
• wangsiping97 / FastGEMV
  High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.
  ☆127Updated last year
• jafermarq / WinogradAwareNets
  Official implementation of "Searching for Winograd-aware Quantized Networks" (MLSys'20)
  ☆27Updated 2 years ago
• mit-han-lab / tinychat-tutorial
  ☆77Updated last year
• e-dupuis / awesome-approximate-dnn
  Curated content for DNN approximation, acceleration ... with a focus on hardware accelerator and deployment
  ☆27Updated last year