This reference can be used with any existing OpenAI integrated apps to run with TRT-LLM inference locally on GeForce GPU on Windows instead of cloud.
☆126Feb 29, 2024Updated 2 years ago
Alternatives and similar repositories for trt-llm-as-openai-windows
Users that are interested in trt-llm-as-openai-windows are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A developer reference project for creating Retrieval Augmented Generation (RAG) chatbots on Windows using TensorRT-LLM☆3,108Jan 21, 2026Updated 9 months ago
- Text-Guided Generation of Full-Body Image with Preserved Reference Face for Customized Animation☆24Jun 24, 2024Updated 2 years ago
- The hackpack is a collection of resources to get started, and continue, your understanding of artificial intelligence.☆10Nov 1, 2018Updated 8 years ago
- A one-stop library to standardize the inference and evaluation of all the conditional video generation models.☆50Feb 13, 2025Updated last year
- Official code and data of "3AM: An Ambiguity-Aware Multi-Modal Machine Translation Dataset"☆13Dec 8, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The Triton TensorRT-LLM Backend☆944Nov 2, 2026Updated 2 weeks ago
- ☆11Aug 26, 2024Updated 2 years ago
- GenAI Examples☆17Dec 13, 2024Updated last year
- The NVIDIA RTX™ AI Toolkit is a suite of tools and SDKs for Windows developers to customize, optimize, and deploy AI models across RTX PC…☆187Nov 24, 2025Updated 11 months ago
- ☆30Aug 21, 2024Updated 2 years ago
- ☆50Jun 7, 2025Updated last year
- Useful utilities for huggingface☆26Oct 28, 2026Updated 3 weeks ago
- ☆17Apr 29, 2025Updated last year
- ☆10Mar 16, 2022Updated 4 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Run Vision LLMs, TTS and STT APIs. Website and API for https://text-generator.io☆38Nov 8, 2026Updated last week
- NVIDIA’s latest recommended recipes for running models on NVIDIA local hardware☆32Updated this week
- Simple Chainlit UI for running llms from Groq and LangChain☆17Feb 28, 2024Updated 2 years ago
- Linkedin profile analyzer - built using openai assistants api, retrieval and gpt4 vision custom function☆35Feb 12, 2024Updated 2 years ago
- [prod] - 🚀 Strapi Exporter: Supercharge Your Obsidian-to-Strapi Workflow, export an obsidian notes directly to your Strapi API☆20Updated this week
- The Triton repository agent that verifies model checksums.☆14Nov 2, 2026Updated 2 weeks ago
- ☆17Nov 22, 2024Updated last year
- ☆19Sep 4, 2024Updated 2 years ago
- ☆11Mar 15, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Safely push a Cog model version by making sure it works and is backwards-compatible with previous versions.☆17Nov 5, 2026Updated 2 weeks ago
- Website for the ICML 2021 tutorial on Random Matrix Theory and Machine Learning☆16Dec 8, 2021Updated 4 years ago
- Implementation of "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"☆40Nov 11, 2024Updated 2 years ago
- SPARQL lexer and parser for RDF.rb. (Deprecated, now integrated in sparql gem).☆10May 1, 2011Updated 15 years ago
- An end to end ML project. Using MLflow for experiment tracking and model registry. Prefect for workflow orchestration. S3 for artifacts s…☆12Sep 11, 2022Updated 4 years ago
- Nesedah Theme with Rik icons☆13Oct 4, 2021Updated 5 years ago
- This is the repo with the code to conduct a comparative analysis of different audio representation models.☆11Aug 31, 2023Updated 3 years ago
- Fine-tune of Florence-2 for shot categorization.☆26Mar 6, 2025Updated last year
- ☆20Jan 17, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Bringing large-language models and chat to web browsers. Everything runs inside the browser with no server support.☆16Jun 5, 2026Updated 5 months ago
- Offline version of the NanoPy Editor. No server needed.☆14Mar 7, 2025Updated last year
- Official Pytorch Implementation of Paper - Stable-Pose: Leveraging Transformers for Pose-Guided Text-to-Image Generation - NeurIPS 2024☆112Dec 23, 2024Updated last year
- ☆14May 14, 2021Updated 5 years ago
- An open-source framework designed to extend and maintain the ESCO taxonomy☆19Mar 12, 2026Updated 8 months ago
- Official Implementation for "Block and Detail: Scaffolding Sketch-to-Image Generation"☆40Oct 30, 2024Updated 2 years ago
- Integrating SSE with NVIDIA Triton Inference Server using a Python backend and Zephyr model. There is very less documentation how to use …☆10May 29, 2024Updated 2 years ago
Are these results useful?