Alternatives and similar repositories for bfloat16

Users that are interested in bfloat16 are comparing it to the libraries listed below

• jundaf2 / INT8-Flash-Attention-FMHA-Quantization
  ☆160Updated 2 years ago
• fastmachinelearning / qonnx
  QONNX: Arbitrary-Precision Quantized Neural Networks in ONNX
  ☆173Updated last week
• Qualcomm-AI-research / FP8-quantization
  ☆170Updated 2 years ago
• CAS-CLab / BlockConv
  [TCAD 2021] Block Convolution: Towards Memory-Efficient Inference of Large-Scale CNNs on FPGA
  ☆17Updated 3 years ago
• jaewoosong / pocketnn
  The official, proof-of-concept C++ implementation of PocketNN.
  ☆36Updated 4 months ago
• AndrewZhaoLuo / TVM-Sandbox
  Sandbox for TVM and playing around!
  ☆22Updated 3 years ago
• moonquest-ai / SRDA
  ☆29Updated 7 months ago
• gau-nernst / quantized-training
  Explore training for quantized models
  ☆26Updated 6 months ago
• masahi / torchscript-to-tvm
  ☆68Updated 2 years ago
• tum-ei-eda / mlonmcu
  Tool for the deployment and analysis of TinyML applications on TFLM and MicroTVM backends
  ☆33Updated this week
• facebookexperimental / protoquant
  Prototype routines for GPU quantization written using PyTorch.
  ☆21Updated 2 weeks ago
• LeiWang1999 / AutoGPTQ.tvm
  GPTQ inference TVM kernel
  ☆41Updated last year
• hpcaitech / TensorNVMe
  A Python library transfers PyTorch tensors between CPU and NVMe
  ☆125Updated last year
• ucb-bar / onnxruntime-riscv
  Fork of upstream onnxruntime focused on supporting risc-v accelerators
  ☆88Updated 2 years ago
• spcl / daceml
  A Data-Centric Compiler for Machine Learning
  ☆85Updated last month
• facebookresearch / any4
  Quantize transformers to any learned arbitrary 4-bit numeric format
  ☆51Updated last week
• cchan / fp8_mul
  A tiny FP8 multiplication unit written in Verilog. TinyTapeout 2 submission.
  ☆14Updated 3 years ago
• yuzhenmao / IceFormer
  Implementation of IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUs (ICLR 2024).
  ☆25Updated 6 months ago
• nycu-caslab / TinyTS
  This is the open-source version of TinyTS. The code is dirty so far. We may clean the code in the future.
  ☆19Updated 5 months ago
• iree-org / iree-nvgpu
  ☆50Updated last year
• wangsiping97 / FastGEMV
  High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.
  ☆127Updated last year
• benja263 / Integer-Only-Inference-for-Deep-Learning-in-Native-C
  Converting a deep neural network to integer-only inference in native C via uniform quantization and the fixed-point representation.
  ☆26Updated 4 years ago
• SeoLabCornell / torch2chip
  Torch2Chip (MLSys, 2024)
  ☆55Updated 9 months ago
• nod-ai / SRT
  Nod.ai 🦈 version of 👻 . You probably want to start at https://github.com/nod-ai/shark for the product and the upstream IREE repository …
  ☆107Updated last month
• IBM / triton-dejavu
  Framework to reduce autotune overhead to zero for well known deployments.
  ☆94Updated 4 months ago
• Harry-Chen / InfMoE
  Inference framework for MoE layers based on TensorRT with Python binding
  ☆41Updated 4 years ago
• SqueezeAILab / open_source_projects
  Open Source Projects from Pallas Lab
  ☆21Updated 4 years ago
• IST-DASLab / QIGen
  Repository for CPU Kernel Generation for LLM Inference
  ☆27Updated 2 years ago
• meta-pytorch / triton-cpu
  An experimental CPU backend for Triton (https//github.com/openai/triton)
  ☆48Updated 5 months ago
• ankan-ban / llama_cu_awq
  llama INT4 cuda inference with AWQ
  ☆55Updated last year