Alternatives and similar repositories for benchmark-pytorch2.0-with-nebullvm:

Users that are interested in benchmark-pytorch2.0-with-nebullvm are comparing it to the libraries listed below

• PINTO0309 / whisper-onnx-tensorrt
  ONNX and TensorRT implementation of Whisper
  ☆61Updated last year
• FrancescoSaverioZuppichini / dynamic-batching-asyncio
  ☆32Updated 2 years ago
• philschmid / optimum-static-quantization
  ☆28Updated last year
• aniketmaurya / stable_diffusion_inference
  Simple and easy stable diffusion inference with LightningModule on GPU, CPU and MPS (Possibly all devices supported by Lightning).
  ☆17Updated last year
• triple-Mu / TensorRT2ONNX
  A tool convert TensorRT engine/plan to a fake onnx
  ☆38Updated 2 years ago
• onnx / neural-compressor
  Model compression for ONNX
  ☆91Updated 5 months ago
• sdpython / onnx-extended
  New operators for the ReferenceEvaluator, new kernels for onnxruntime, CPU, CUDA
  ☆32Updated last month
• k9ele7en / Triton-TensorRT-Inference-CRAFT-pytorch
  Advanced inference pipeline using NVIDIA Triton Inference Server for CRAFT Text detection (Pytorch), included converter from Pytorch -> O…
  ☆33Updated 3 years ago
• jundaf2 / INT8-Flash-Attention-FMHA-Quantization
  ☆157Updated last year
• triton-inference-server / onnxruntime_backend
  The Triton backend for the ONNX Runtime.
  ☆140Updated last week
• roboflow / deploy-models-with-grpc-pytorch-asyncio
  Article about deploying machine learning models using grpc, pytorch and asyncio
  ☆28Updated 2 years ago
• mtszkw / fast-torch
  Comparing PyTorch, JIT and ONNX for inference with Transformers
  ☆18Updated 4 years ago
• learning-at-home / lean_transformer
  Memory-efficient transformer. Work in progress.
  ☆19Updated 2 years ago
• triton-inference-server / tensorrt_backend
  The Triton backend for TensorRT.
  ☆73Updated this week
• crypdick / timm-lr-scheduler-explorer
  A dashboard for exploring timm learning rate schedulers
  ☆19Updated 5 months ago
• gnovack / distributed-training-and-deepspeed
  ☆17Updated last year
• dusty-nv / NanoDB
  Zero-copy multimodal vector DB with CUDA and CLIP/SigLIP
  ☆54Updated 10 months ago
• lessw2020 / transformer_central
  Various transformers for FSDP research
  ☆37Updated 2 years ago
• aredden / torch-bnb-fp4
  Faster Pytorch bitsandbytes 4bit fp4 nn.Linear ops
  ☆28Updated last year
• PINTO0309 / sne4onnx
  A very simple tool for situations where optimization with onnx-simplifier would exceed the Protocol Buffers upper file size limit of 2GB,…
  ☆16Updated 11 months ago
• quic / efficient-transformers
  This library empowers users to seamlessly port pretrained models and checkpoints on the HuggingFace (HF) hub (developed using HF transfor…
  ☆62Updated this week
• fpaupier / gRPC-multiprocessing
  A boilerplate to use multiprocessing for your gRPC server in your Python project
  ☆25Updated 3 years ago
• facebookresearch / fairring
  Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …
  ☆65Updated 3 years ago
• luxonis / blobconverter
  Web-based tool to convert model into MyriadX blob
  ☆16Updated last week
• lucasjinreal / wnnx_models
  Various test models in WNNX format. It can view with `pip install wnetron && wnetron`
  ☆12Updated 2 years ago
• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆40Updated last year
• mcarilli / mixed_precision_references
  Personal collection of references for high performance mixed precision training.
  ☆41Updated 5 years ago
• Lightning-Universe / lightning-ColossalAI
  Large Scale Distributed Model Training strategy with Colossal AI and Lightning AI
  ☆57Updated last year
• Zasder3 / open_clip_juwels
  An open source implementation of CLIP.
  ☆32Updated 2 years ago
• triton-inference-server / dali_backend
  The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.
  ☆132Updated this week