Alternatives and similar repositories for pytorch-benchmarks

Users that are interested in pytorch-benchmarks are comparing it to the libraries listed below

• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆93Updated this week
• groq / mlagility
  Machine Learning Agility (MLAgility) benchmark and benchmarking tools
  ☆40Updated 6 months ago
• HabanaAI / Megatron-DeepSpeed
  Intel Gaudi's Megatron DeepSpeed Large Language Models for training
  ☆18Updated last year
• mlcommons / logging
  MLPerf™ logging library
  ☆38Updated last month
• axonn-ai / axonn
  Parallel framework for training and fine-tuning deep neural networks
  ☆70Updated 3 months ago
• determined-ai / determined-examples
  Example ML projects that use the Determined library.
  ☆32Updated last year
• facebookresearch / any4
  Quantize transformers to any learned arbitrary 4-bit numeric format
  ☆50Updated 2 weeks ago
• reger-men / HPL_GPU
  High-Performance Linpack Benchmark adopted version for GPU backend
  ☆12Updated 3 years ago
• CentML / DeepView.Profile
  🏙 Interactive performance profiling and debugging tool for PyTorch neural networks.
  ☆64Updated last year
• 7shoe / AdaParse
  Adaptive Parallel PDF Parsing and Resource Scaling Engine
  ☆62Updated last month
• foundation-model-stack / fms-acceleration
  🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.
  ☆13Updated last week
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆137Updated 8 months ago
• HamzaElshafie / h100_gemm
  A series of high-performance GEMM (General Matrix Multiply) implementations Iteratively optimised for H100 GPUs in Pure CUDA.
  ☆64Updated last month
• wdlctc / headinfer
  ☆64Updated 8 months ago
• Michaelvll / llm-ie-benchmarks
  A collection of reproducible inference engine benchmarks
  ☆38Updated 9 months ago
• qoofyk / LLM_Sizing_Guide
  A calculator to estimate the memory footprint, capacity, and latency on VMware Private AI with NVIDIA.
  ☆38Updated 6 months ago
• ailzhang / minPP
  Pipeline parallelism for the minimalist
  ☆40Updated 6 months ago
• abacusai / gh200-llm
  Docker image NVIDIA GH200 machines - optimized for vllm serving and hf trainer finetuning
  ☆53Updated 11 months ago
• mag- / gpu_benchmark
  Gpu benchmark
  ☆74Updated last year
• deepspeedai / DeepSpeed-Kernels
  ☆71Updated 10 months ago
• pilancilab / caldera
  Compressing Large Language Models using Low Precision and Low Rank Decomposition
  ☆106Updated 2 months ago
• epoch-research / Compute-Trends
  Supplementary material for our paper "Compute Trends Across Three Eras of Machine Learning".
  ☆45Updated 3 years ago
• intel / torch-ccl
  oneCCL Bindings for Pytorch* (deprecated)
  ☆104Updated last month
• facebookresearch / FAMBench
  Benchmarks to capture important workloads.
  ☆32Updated this week
• graphcore-research / unit-scaling-demo
  Unit Scaling demo and experimentation code
  ☆16Updated last year
• HabanaAI / Model-References
  Reference models for Intel(R) Gaudi(R) AI Accelerator
  ☆170Updated last month
• Snowflake-Labs / vllm
  ☆16Updated 2 months ago
• FrancescoSaverioZuppichini / pytorch-2.0-benchmark
  Benchmarking PyTorch 2.0 different models
  ☆20Updated 2 years ago
• minyoungg / LTE
  ☆71Updated last year
• NVIDIA / free-threaded-python
  No-GIL Python environment featuring NVIDIA Deep Learning libraries.
  ☆70Updated 9 months ago