Alternatives and similar repositories for tao_deploy:

Users that are interested in tao_deploy are comparing it to the libraries listed below

• NVIDIA / tao_tensorflow1_backend
  TAO Toolkit deep learning networks with TensorFlow 1.x backend
  ☆13Updated last year
• NVIDIA / tao_tutorials
  Quick start scripts and tutorial notebooks to get started with TAO Toolkit
  ☆66Updated 5 months ago
• NVlabs / HALP
  ☆66Updated 2 years ago
• mit-han-lab / tinychat-tutorial
  ☆59Updated 3 months ago
• NVIDIA / tao_pytorch_backend
  TAO Toolkit deep learning networks with PyTorch backend
  ☆91Updated 3 months ago
• Oneflow-Inc / vision
  Datasets, Transforms and Models specific to Computer Vision
  ☆84Updated last year
• NVIDIA / Deep-Learning-Accelerator-SW
  NVIDIA DLA-SW, the recipes and tools for running deep learning workloads on NVIDIA DLA cores for inference applications.
  ☆187Updated 8 months ago
• NVIDIA-AI-IOT / nvidia-tao
  ☆92Updated 5 months ago
• NVlabs / EfficientDL
  ☆31Updated 7 months ago
• dusty-nv / clip_trt
  CLIP and SigLIP models optimized with TensorRT with a Transformers-like API
  ☆21Updated 4 months ago
• DefTruth / ffpa-attn-mma
  📚FFPA: Yet antother Faster Flash Prefill Attention with O(1)⚡️SRAM complexity for headdim > 256, 1.8x~3x↑🎉faster than SDPA EA.
  ☆96Updated this week
• leimao / TensorRT-Custom-Plugin-Example
  Quick and Self-Contained TensorRT Custom Plugin Implementation and Integration
  ☆51Updated 8 months ago
• NVlabs / COAT
  ☆65Updated last week
• ICT-ANS / StarLight
  ☆59Updated 7 months ago
• facebookresearch / DeltaCNN
  DeltaCNN End-to-End CNN Inference of Sparse Frame Differences in Videos
  ☆60Updated last year
• quic / efficient-transformers
  This library empowers users to seamlessly port pretrained models and checkpoints on the HuggingFace (HF) hub (developed using HF transfor…
  ☆57Updated this week
• mit-han-lab / Block-Sparse-Attention
  A sparse attention kernel supporting mix sparse patterns
  ☆108Updated this week
• ankan-ban / llama_cu_awq
  llama INT4 cuda inference with AWQ
  ☆50Updated 3 weeks ago
• facebookresearch / DepthShrinker
  [ICML 2022] "DepthShrinker: A New Compression Paradigm Towards Boosting Real-Hardware Efficiency of Compact Neural Networks", by Yonggan …
  ☆71Updated 2 years ago
• ojh6404 / deep_vision_ros
  ROS package for SOTA Computer Vision Models including SAM, Cutie, GroundingDINO, YOLO-World, VLPart, DEVA and MaskDINO.
  ☆43Updated 6 months ago
• L1aoXingyu / llm-infer-bench
  ☆11Updated last year
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆103Updated 5 months ago
• triple-Mu / TensorRT2ONNX
  A tool convert TensorRT engine/plan to a fake onnx
  ☆37Updated 2 years ago
• indri-voice / vit.triton
  VIT inference in triton because, why not?
  ☆22Updated 8 months ago
• ultralytics / thop
  Profile PyTorch models for FLOPs and parameters, helping to evaluate computational efficiency and memory usage.
  ☆29Updated 3 weeks ago
• NVIDIA-AI-IOT / jetson-platform-services
  A collection of reference AI microservices and workflows for Jetson Platform Services
  ☆34Updated 2 weeks ago
• tile-ai / tvm
  Open deep learning compiler stack for cpu, gpu and specialized accelerators
  ☆18Updated last week
• chhzh123 / ptc-tutorial
  PyTorch compilation tutorial covering TorchScript, torch.fx, and Slapo
  ☆19Updated last year
• MegEngine / examples
  A set of examples around MegEngine
  ☆31Updated last year
• caiwanxianhust / FasterLLaMA
  使用 CUDA C++ 实现的 llama 模型推理框架
  ☆44Updated 3 months ago