This reference can be used with any existing OpenAI integrated apps to run with TRT-LLM inference locally on GeForce GPU on Windows instead of cloud.
☆127Feb 29, 2024Updated 2 years ago
Alternatives and similar repositories for trt-llm-as-openai-windows
Users that are interested in trt-llm-as-openai-windows are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- OpenAI compatible API for TensorRT LLM triton backend☆221Aug 1, 2024Updated 2 years ago
- ☆13Feb 18, 2024Updated 2 years ago
- Flask API for generating text embeddings using OpenAI or sentence_transformers☆14Sep 1, 2023Updated 3 years ago
- ☆25Feb 18, 2024Updated 2 years ago
- Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…☆59Aug 29, 2026Updated 3 weeks ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Text-Guided Generation of Full-Body Image with Preserved Reference Face for Customized Animation☆24Jun 24, 2024Updated 2 years ago
- TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizat…☆14,666Updated this week
- Wyoming protocol server that calls an external program to play audio☆19Apr 28, 2024Updated 2 years ago
- Star Trek Game☆14Feb 16, 2021Updated 5 years ago
- ☆30Aug 21, 2024Updated 2 years ago
- ☆14Feb 18, 2023Updated 3 years ago
- ☆24Mar 10, 2025Updated last year
- Linkedin profile analyzer - built using openai assistants api, retrieval and gpt4 vision custom function☆35Feb 12, 2024Updated 2 years ago
- Run Vision LLMs, TTS and STT APIs. Website and API for https://text-generator.io☆38Jul 16, 2026Updated 2 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- ☆11Feb 16, 2021Updated 5 years ago
- Code for "Fine-Tuning by Curriculum Learning for Non-Autoregressive Neural Machine Translation"☆13Jul 10, 2020Updated 6 years ago
- experiments with inference on llama☆103Jun 6, 2024Updated 2 years ago
- Offline version of the NanoPy Editor. No server needed.☆14Mar 7, 2025Updated last year
- A Suite for Parallel Inference of Diffusion Transformers (DiTs) on multi-GPU Clusters☆58May 3, 2026Updated 4 months ago
- [prod] - 🚀 Strapi Exporter: Supercharge Your Obsidian-to-Strapi Workflow, export an obsidian notes directly to your Strapi API☆20Updated this week
- The NVIDIA RTX™ AI Toolkit is a suite of tools and SDKs for Windows developers to customize, optimize, and deploy AI models across RTX PC…☆186Nov 24, 2025Updated 9 months ago
- This is the official code for paper: [PiVe: Prompting with Iterative Verification Improving Graph-based Generative Capability of LLMs]☆37Aug 31, 2024Updated 2 years ago
- 大模型部署实战：TensorRT-LLM, Triton Inference Server, vLLM☆26Feb 26, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Render human motion sequences with Blender, with or without overlaying on a video☆17Jul 23, 2026Updated last month
- Safely push a Cog model version by making sure it works and is backwards-compatible with previous versions.☆17Dec 4, 2025Updated 9 months ago
- Python interface of C3Dserver software for reading and editing C3D motion capture files☆15Jul 9, 2025Updated last year
- Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification☆11Aug 12, 2023Updated 3 years ago
- Annotation builder to use segmentation in Mask_RCNN, even if your annotations are rectangular instead of polygon.☆15Feb 16, 2022Updated 4 years ago
- Facebook AI Research Sequence-to-Sequence Toolkit written in Python.☆12Oct 10, 2020Updated 5 years ago
- An open-source framework designed to extend and maintain the ESCO taxonomy☆18Mar 12, 2026Updated 6 months ago
- Experiment with NVIDIA Triton and Whisper☆15Apr 29, 2024Updated 2 years ago
- This is the code for reproducing the TABBIE baseline in our paper: "Retrieval-Based Transformer for Table Augmentation"☆12Sep 17, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆28May 3, 2023Updated 3 years ago
- Taking Language Embedded 3D Gaussian Splatting into the Wild☆15Jul 9, 2026Updated 2 months ago
- LLM-Training-API: Including Embeddings & ReRankers, mergekit, LaserRMT☆28Feb 18, 2024Updated 2 years ago
- NMT with ssp☆11Oct 28, 2021Updated 4 years ago
- Probabilistic LLM evaluations. [CogSci2023; ACL2023]☆73Jul 27, 2024Updated 2 years ago
- Shader library for HeavyM, ISF format, mostly from Shadertoy.com☆22Dec 22, 2021Updated 4 years ago
- Expanded KR-BERT by adding more training data☆13Apr 23, 2021Updated 5 years ago