rajeevsrao / TensorRTLinks
TensorRT is a C++ library for high performance inference on NVIDIA GPUs and deep learning accelerators.
☆20Updated last year
Alternatives and similar repositories for TensorRT
Users that are interested in TensorRT are comparing it to the libraries listed below
Sorting:
- stable diffusion, controlnet, tensorrt, accelerate☆58Updated 2 years ago
- Flux diffusion model implementation using quantized fp8 matmul & remaining layers use faster half precision accumulate, which is ~2x fast…☆287Updated last year
- https://wavespeed.ai/ Context parallel attention that accelerates DiT model inference with dynamic caching☆396Updated 5 months ago
- Experimental usage of stable-fast and TensorRT.☆208Updated last year
- Faster generation with text-to-image diffusion models.☆231Updated 5 months ago
- End-to-end recipes for optimizing diffusion models with torchao and diffusers (inference and FP8 training).☆388Updated 6 months ago
- Official Repository of the paper "Trajectory Consistency Distillation"☆356Updated last year
- ☆442Updated last year
- ☆315Updated 2 years ago
- SSD-1B, an open-source text-to-image model, outperforming previous versions by being 50% smaller and 60% faster than SDXL.☆178Updated last year
- Generate long weighted prompt embeddings for Stable Diffusion☆145Updated 7 months ago
- Quantized stable-diffusion cutting down memory 75%, testing in streamlit, deploying in container☆54Updated 3 weeks ago
- Tiny optimized Stable-diffusion that can run on GPUs with just 1GB of VRAM. (Beta)☆180Updated 2 years ago
- Real-time inference for Stable Diffusion - 0.88s latency. Covers AITemplate, nvFuser, TensorRT, FlashAttention. Join our Discord communty…☆560Updated 2 years ago
- Segmind Distilled diffusion☆620Updated 2 years ago
- Repo for my Tensorflow/Keras CV experiments. Mostly revolving around the Danbooru20xx dataset☆124Updated 2 years ago
- https://wavespeed.ai/ Best inference performance optimization framework for HuggingFace Diffusers on NVIDIA GPUs.☆1,292Updated 8 months ago
- Deploy stable diffusion model with onnx/tenorrt + tritonserver☆127Updated 2 years ago
- [NeurIPS 2024] AsyncDiff: Parallelizing Diffusion Models by Asynchronous Denoising☆208Updated 2 months ago
- [ECCV 2024] HiDiffusion: Increases the resolution and speed of your diffusion model by only adding a single line of code!☆834Updated last year
- AuraSR: GAN-based Super-Resolution for real-world☆511Updated last year
- Accelerates Flux.1 image generation, just by using this node.☆141Updated 11 months ago
- ☆447Updated last year
- An efficient implementation of Stable-Diffusion-XL☆47Updated 2 years ago
- The first open source triton inference engine for Stable Diffusion, specifically for sdxl☆12Updated 2 years ago
- Example code and documentation on how to get Stable Diffusion running with ONNX FP16 models on DirectML. Can run accelerated on all Direc…☆301Updated 2 years ago
- ⚡ Flash Diffusion ⚡: Accelerating Any Conditional Diffusion Model for Few Steps Image Generation (AAAI 2025 Oral)☆642Updated 8 months ago
- ☆474Updated 7 months ago
- InstantID-ROME: Improved Identity-Preserving Generation in Seconds 🔥☆235Updated last year
- webui for HCP-Diffusion☆140Updated 2 years ago