TensorRT-in-Action 是一个 GitHub 代码库，提供了使用 TensorRT 的代码示例，并有对应 Jupyter Notebook。
☆15Jun 1, 2023Updated 3 years ago
Alternatives and similar repositories for TensorRT-in-Action
Users that are interested in TensorRT-in-Action are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- learn TensorRT from scratch🥰☆18Sep 29, 2024Updated 2 years ago
- Benchmark tests supporting the TiledCUDA library.☆19Nov 19, 2024Updated last year
- Several optimization methods of half-precision general matrix vector multiplication (HGEMV) using CUDA core.☆77Sep 8, 2024Updated 2 years ago
- a repo to study TensorRT Plugin☆11Apr 30, 2025Updated last year
- Flash Attention in ~100 lines of CUDA (forward pass only)☆12Jun 10, 2024Updated 2 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Tutorials of Extending and importing TVM with CMAKE Include dependency.☆16Oct 11, 2024Updated 2 years ago
- ☆27Aug 5, 2022Updated 4 years ago
- List of papers related to Vision Transformers quantization and hardware acceleration in recent AI conferences and journals.☆108Jun 2, 2024Updated 2 years ago
- [HPCA 2026] A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.☆104May 14, 2026Updated 5 months ago
- Examples of CUDA implementations by Cutlass CuTe☆283Jul 1, 2025Updated last year
- HKUST(GZ) Marpit Template for Presentation☆10Nov 21, 2022Updated 3 years ago
- AXI4 to SRAM Interface☆13May 2, 2022Updated 4 years ago
- Awesome Quantization Paper lists with Codes☆10Feb 24, 2021Updated 5 years ago
- GEMV implementation with CUTLASS☆21Aug 21, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- [EMNLP24]LPZero: Language Model Zero-Cost Proxy Search from Zero☆11Oct 21, 2024Updated 2 years ago
- ☆10Jun 28, 2019Updated 7 years ago
- MICRO 2023 Evaluation Artifact for TeAAL☆13Oct 26, 2023Updated 3 years ago
- Deep Variational Information Bottleneck (DVIB) in PyTorch.☆10Apr 25, 2020Updated 6 years ago
- ☆40Dec 14, 2025Updated 10 months ago
- pytorch版unilm模型☆25Jun 19, 2021Updated 5 years ago
- More Tokens, Lower Precision: Towards the Optimal Token-Precision Trade-off in KV Cache Compression（EMNLP 2025）☆12Jan 15, 2025Updated last year
- Efficient and unified implementations for TopK-based sparse attention☆41Jul 10, 2026Updated 3 months ago
- ☆15Jul 10, 2026Updated 3 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- PyTorch code for our paper "Progressive Binarization with Semi-Structured Pruning for LLMs"☆12Jul 11, 2026Updated 3 months ago
- useful cuda code .☆44Mar 11, 2022Updated 4 years ago
- Live demo of hls4ml on embedded platforms such as the Pynq-Z2☆13Aug 23, 2024Updated 2 years ago
- Code for: Algorithm-hardware co-design of neuromorphic networks with dual memory pathways☆17Sep 18, 2026Updated last month
- PyTorch implementation of "Deep Transferring Quantization" (ECCV2020)☆18Jun 22, 2022Updated 4 years ago
- ☆16Jan 18, 2025Updated last year
- Some C++/C/CUDA Extension☆16Feb 2, 2022Updated 4 years ago
- Models and examples built with hls4ml☆12Apr 8, 2020Updated 6 years ago
- Fast Emulation of Approximate ViT models in PyTorch☆13Feb 13, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Low Precision Arithmetic Simulation in PyTorch - extension for posit and beyond☆16Dec 9, 2025Updated 10 months ago
- FuseFL: One-Shot Federated Learning through the Lens of Causality with Progressive Model Fusion (NeurIPS 2024 Spotlight)☆14Mar 31, 2025Updated last year
- 放一些论文，简历之类的latex模板☆12Aug 4, 2026Updated 2 months ago
- AFP is a hardware-friendly quantization framework for DNNs, which is contributed by Fangxin Liu and Wenbo Zhao.☆13Nov 8, 2021Updated 4 years ago
- 车道线检测Lanenet TensorRT加速C++实现☆23Feb 24, 2022Updated 4 years ago
- ☆11Oct 10, 2019Updated 7 years ago
- Benchmarking code for running quantized kernels from vLLM and other libraries☆14Dec 3, 2024Updated last year