Whisper inference with TensorRT-LLM
☆25Sep 22, 2023Updated 2 years ago
Alternatives and similar repositories for Eddie-Wang-Hackathon2023
Users that are interested in Eddie-Wang-Hackathon2023 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆26Aug 15, 2023Updated 3 years ago
- ☆27Sep 1, 2023Updated 3 years ago
- Serverless LLM Inference: Deploy DeepSeek R1 & LLaMA Models on AWS Lambda with Ultra-Fast Cold Starts☆14Feb 3, 2026Updated 7 months ago
- ☆17Jun 8, 2019Updated 7 years ago
- Deploy ChatGLM on Modelz☆16Mar 20, 2023Updated 3 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Implemented a script that automatically adjusts Qwen3's inference and non-inference capabilities, based on an OpenAI-like API. The infere…☆22May 9, 2025Updated last year
- A simple tool to profile performance of multiple combinations of GEMM of cuBLAS