Alternatives and similar repositories for who_what_benchmark

Users that are interested in who_what_benchmark are comparing it to the libraries listed below

• huggingface / optimum-intel
  🤗 Optimum Intel: Accelerate inference with Intel optimization tools
  ☆465Updated this week
• huggingface / optimum-benchmark
  🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…
  ☆301Updated this week
• intel / neural-speed
  An innovative library for efficient LLM inference via low-bit quantization
  ☆349Updated 8 months ago
• huggingface / optimum-habana
  Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)
  ☆186Updated this week
• slyalin / openvino_devtools
  Tools for easier OpenVINO development/debugging
  ☆9Updated 2 months ago
• neuralmagic / nm-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆263Updated 7 months ago
• HabanaAI / vllm-fork
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆71Updated this week
• intel / auto-round
  Advanced Quantization Algorithm for LLMs/VLMs.
  ☆460Updated this week
• NetEase-FuXi / EETQ
  Easy and Efficient Quantization for Transformers
  ☆197Updated 3 months ago
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆104Updated 11 months ago
• triton-inference-server / vllm_backend
  ☆255Updated last week
• openvinotoolkit / openvino.genai
  Run Generative AI models with simple C++/Python API and using OpenVINO Runtime
  ☆274Updated this week
• openvinotoolkit / nncf
  Neural Network Compression Framework for enhanced OpenVINO™ inference
  ☆1,027Updated this week
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆136Updated 9 months ago
• huggingface / optimum-quanto
  A pytorch quantization backend for optimum
  ☆935Updated 3 weeks ago
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆109Updated 3 months ago
• NVIDIA / logits-processor-zoo
  A collection of LogitsProcessors to customize and enhance LLM behavior for specific tasks.
  ☆283Updated last week
• pytorch-labs / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆267Updated this week
• mobiusml / hqq
  Official implementation of Half-Quadratic Quantization (HQQ)
  ☆810Updated this week
• hkproj / quantization-notes
  Notes on quantization in neural networks
  ☆82Updated last year
• NVIDIA / TensorRT-Model-Optimizer
  nvidia-modelopt is a unified library of state-of-the-art model optimization techniques like quantization, pruning, distillation, speculat…
  ☆922Updated this week
• mobiusml / gemlite
  Fast low-bit matmul kernels in Triton
  ☆301Updated this week
• HabanaAI / Model-References
  Reference models for Intel(R) Gaudi(R) AI Accelerator
  ☆162Updated 2 weeks ago
• foundation-model-stack / foundation-model-stack
  🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.
  ☆195Updated this week
• facebookresearch / SpinQuant
  Code repo for the paper "SpinQuant LLM quantization with learned rotations"
  ☆272Updated 3 months ago
• microsoft / batch-inference
  Dynamic batching library for Deep Learning inference. Tutorials for LLM, GPT scenarios.
  ☆97Updated 9 months ago
• microsoft / onnxscript
  ONNX Script enables developers to naturally author ONNX functions and models using a subset of Python.
  ☆351Updated this week
• MekkCyber / CutlassAcademy
  A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS
  ☆173Updated last week
• pytorch / PiPPy
  Pipeline Parallelism for PyTorch
  ☆765Updated 8 months ago
• huggingface / inference-benchmarker
  Inference server benchmarking tool
  ☆59Updated 3 weeks ago