This reference can be used with any existing OpenAI integrated apps to run with TRT-LLM inference locally on GeForce GPU on Windows instead of cloud.
☆128Feb 29, 2024Updated 2 years ago
Alternatives and similar repositories for trt-llm-as-openai-windows
Users that are interested in trt-llm-as-openai-windows are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A developer reference project for creating Retrieval Augmented Generation (RAG) chatbots on Windows using TensorRT-LLM☆3,115Jan 21, 2026Updated 2 months ago
- ☆13Feb 18, 2024Updated 2 years ago
- All-in-one Full-Featured Python/Flet/Flutter Application to make the most of all the latest Open-Source AI Art Generators in an intuitive…☆16May 30, 2025Updated 9 months ago
- Text-Guided Generation of Full-Body Image with Preserved Reference Face for Customized Animation☆24Jun 24, 2024Updated last year
- Flask API for generating text embeddings using OpenAI or sentence_transformers☆14Sep 1, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- ☆30Aug 21, 2024Updated last year
- Run Vision LLMs, TTS and STT APIs. Website and API for https://text-generator.io☆39Mar 4, 2026Updated 3 weeks ago
- An OpenAI API compatible images server to generate or manipulate images.☆17Feb 2, 2025Updated last year
- ☆25Feb 18, 2024Updated 2 years ago
- Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…☆58Updated this week
- TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizat…☆13,169Updated this week
- ☆14Nov 22, 2024Updated last year
- experiments with inference on llama☆103Jun 6, 2024Updated last year
- A one-stop library to standardize the inference and evaluation of all the conditional video generation models.☆51Feb 13, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- HunyuanVideo: A Systematic Framework For Large Video Generation Model☆48Dec 14, 2024Updated last year
- ☆42Mar 10, 2026Updated 2 weeks ago
- This is the repo with the code to conduct a comparative analysis of different audio representation models.☆12Aug 31, 2023Updated 2 years ago
- Scriptable interface to a powerful, multi-lingual language server☆36Updated this week
- STDFormer: Spatio Temporal Disentanglement Learning for 3D Human Mesh Recovery from Monocular Videos with Transformer☆45Mar 14, 2024Updated 2 years ago
- Official Repo for MoCha Towards Movie-Grade Talking Character Synthesis☆61Dec 27, 2025Updated 3 months ago
- ☆13Feb 18, 2023Updated 3 years ago
- ☆24Mar 6, 2024Updated 2 years ago
- 2D python IDE built into blender as an add-on!☆21Sep 16, 2024Updated last year
- NordVPN Special Discount Offer • AdSave on top-rated NordVPN 1 or 2-year plans with secure browsing, privacy protection, and support for for all major platforms.
- The NVIDIA RTX™ AI Toolkit is a suite of tools and SDKs for Windows developers to customize, optimize, and deploy AI models across RTX PC…☆182Nov 24, 2025Updated 4 months ago
- ☆24Mar 10, 2025Updated last year
- Useful utilities for huggingface☆25Dec 26, 2025Updated 3 months ago
- ☆15Jan 21, 2025Updated last year
- FlexiFilm: Long Video Generation with Flexible Conditions☆31May 1, 2024Updated last year
- NOVA-3D: Non-overlapped Views for 3D Anime Character Reconstruction☆27Mar 14, 2024Updated 2 years ago
- Original implementation of "FLoD: Integrating Flexible Level of Detail into 3D Gaussian Splatting for Customizable Rendering"☆29Sep 1, 2025Updated 6 months ago
- A Suite for Parallel Inference of Diffusion Transformers (DiTs) on multi-GPU Clusters☆57Jul 23, 2024Updated last year
- Generate images from an initial frame and text☆37Jul 28, 2023Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Codebase for the paper HawkI: HawkI: Homography & Mutual Information Guidance for 3D-free Single Image to Aerial View☆13Jun 5, 2024Updated last year
- [IEEE/CVF CVPR'2022] "ST-MFNet: A Spatio-Temporal Multi-Flow Network for Frame Interpolation", Duolikun Danier, Fan Zhang, David Bull☆13Oct 9, 2023Updated 2 years ago
- Implementation for "Correcting Diffusion Generation through Resampling" [CVPR 2024]☆34Dec 12, 2023Updated 2 years ago
- implementation of AnimateDiff.☆32Jul 14, 2023Updated 2 years ago
- ☆41May 10, 2024Updated last year
- Code of the paper "FBSDiff: Plug-and-Play Frequency Band Substitution of Diffusion Features for Highly Controllable Text-Driven Image Tra…☆23Apr 28, 2025Updated 10 months ago
- Build beautiful marketing sites with SvelteKit - A lightweight, customizable component library for static marketing websites.☆18Mar 28, 2025Updated 11 months ago