This reference can be used with any existing OpenAI integrated apps to run with TRT-LLM inference locally on GeForce GPU on Windows instead of cloud.
☆128Feb 29, 2024Updated 2 years ago
Alternatives and similar repositories for trt-llm-as-openai-windows
Users that are interested in trt-llm-as-openai-windows are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆13Feb 18, 2024Updated 2 years ago
- All-in-one Full-Featured Python/Flet/Flutter Application to make the most of all the latest Open-Source AI Art Generators in an intuitive…☆16May 30, 2025Updated 10 months ago
- ☆30Aug 21, 2024Updated last year
- Run Vision LLMs, TTS and STT APIs. Website and API for https://text-generator.io☆39Apr 17, 2026Updated last week
- GenAI Examples☆16Dec 13, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizat…☆13,487Updated this week
- ☆14Nov 22, 2024Updated last year
- The Triton TensorRT-LLM Backend☆933Apr 22, 2026Updated last week
- experiments with inference on llama☆103Jun 6, 2024Updated last year
- A one-stop library to standardize the inference and evaluation of all the conditional video generation models.☆51Feb 13, 2025Updated last year
- HunyuanVideo: A Systematic Framework For Large Video Generation Model☆48Dec 14, 2024Updated last year
- This is the repo with the code to conduct a comparative analysis of different audio representation models.☆12Aug 31, 2023Updated 2 years ago
- Scriptable interface to a powerful, multi-lingual language server☆38Updated this week
- STDFormer: Spatio Temporal Disentanglement Learning for 3D Human Mesh Recovery from Monocular Videos with Transformer☆45Mar 14, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Copier template for creating a Mopidy extension☆17Nov 24, 2025Updated 5 months ago
- ☆13Feb 18, 2023Updated 3 years ago
- ☆23Feb 21, 2025Updated last year
- ☆15Jan 21, 2025Updated last year
- ☆11Sep 28, 2024Updated last year
- The NVIDIA RTX™ AI Toolkit is a suite of tools and SDKs for Windows developers to customize, optimize, and deploy AI models across RTX PC…☆183Nov 24, 2025Updated 5 months ago
- Offline version of the NanoPy Editor. No server needed.☆14Mar 7, 2025Updated last year
- Auto-Video maker handling many AI's☆11Mar 18, 2024Updated 2 years ago
- FlexiFilm: Long Video Generation with Flexible Conditions☆31May 1, 2024Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆70Mar 10, 2026Updated last month
- ☆12May 23, 2024Updated last year
- NOVA-3D: Non-overlapped Views for 3D Anime Character Reconstruction☆28Mar 14, 2024Updated 2 years ago
- A script for MIDI/AUDIO routing in Max for Live devices.☆12Dec 27, 2024Updated last year
- Knwler is a lightweight, single-file Python tool that extracts structured knowledge graphs from documents using AI. Feed it a PDF or text…☆120Apr 3, 2026Updated 3 weeks ago
- ☆13Apr 8, 2021Updated 5 years ago
- A Suite for Parallel Inference of Diffusion Transformers (DiTs) on multi-GPU Clusters☆58Jul 23, 2024Updated last year
- Generate images from an initial frame and text☆37Jul 28, 2023Updated 2 years ago
- Codebase for the paper HawkI: HawkI: Homography & Mutual Information Guidance for 3D-free Single Image to Aerial View☆13Jun 5, 2024Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆11Nov 10, 2019Updated 6 years ago
- ☆341Updated this week
- [IEEE/CVF CVPR'2022] "ST-MFNet: A Spatio-Temporal Multi-Flow Network for Frame Interpolation", Duolikun Danier, Fan Zhang, David Bull☆13Oct 9, 2023Updated 2 years ago
- An example of using multimodal LLMs to processpide feed from camera and get image description☆15Mar 11, 2024Updated 2 years ago
- 🪐 🎛️ User interface to manage your Jupyter platform.☆17Jun 6, 2025Updated 10 months ago
- implementation of AnimateDiff.☆32Jul 14, 2023Updated 2 years ago
- Code of the paper "FBSDiff: Plug-and-Play Frequency Band Substitution of Diffusion Features for Highly Controllable Text-Driven Image Tra…☆24Apr 28, 2025Updated last year