mistralai / TensorRT-LLMLinks
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
☆15Updated last year
Alternatives and similar repositories for TensorRT-LLM
Users that are interested in TensorRT-LLM are comparing it to the libraries listed below
Sorting:
- Simple CogVLM client script☆14Updated 2 years ago
- ☆20Updated 2 weeks ago
- Streamlit app to Translate text to or between 50 languages with mBART-50 from Huggingface and Facebook☆25Updated 4 years ago
- Example Code to Supplement the Label Studio Blog☆31Updated last month
- ☆12Updated 8 months ago
- Deploy DL/ ML inference pipelines with minimal extra code.☆102Updated last year
- ☆13Updated last year
- Using GPT-3 and Carrot (GPT-3 for computer vision) to create detailed descriptions of images.☆14Updated 3 years ago
- Code for blog posts from OpenCV.AI☆16Updated 2 years ago
- 👤 Human Face and 🎥 Object Detection using OpenCV☆13Updated 2 years ago
- Scripts for pushing models to huggingface repos☆15Updated 4 months ago
- This repository holds files and scripts for incorporating simple CI/CD practices for model training in ML.☆21Updated 4 years ago
- Evaluate the performance of computer vision models and prompts for zero-shot models (Grounding DINO, CLIP, BLIP, DINOv2, ImageBind, model…☆37Updated 2 years ago
- ☆17Updated 3 years ago
- A ⚡️ Lightning.ai ⚡️ app demo for Voice based web search using OpenAI's Whisper and DuckDuckGo☆27Updated 3 years ago
- The NVIDIA RTX™ AI Toolkit is a suite of tools and SDKs for Windows developers to customize, optimize, and deploy AI models across RTX PC…☆181Updated 2 months ago
- A python library for face detection and features extraction based on mediapipe library☆48Updated last year
- Imageinary is a reproducible mechanism which is used to generate large image datasets at various resolutions. The tool supports multiple …☆28Updated 2 years ago
- 3rd party dependencies for DALI project☆11Updated last week
- Building LLMs from scratch following the book from S. Raschka☆32Updated 10 months ago
- Implementation of VisionLLaMA from the paper: "VisionLLaMA: A Unified LLaMA Interface for Vision Tasks" in PyTorch and Zeta☆16Updated last year
- RAG-QA is a free, containerised question-answer framework that allows you to ask questions to your documents in an intuitive way☆19Updated 2 years ago
- Visual similarity search engine demo with use of PyTorch Metric Learning and Qdrant☆12Updated 3 years ago
- Passively collect images for computer vision datasets on the edge.☆35Updated 2 years ago
- Segmenting a given document using recursive xy-cut algorithm.☆12Updated 7 years ago
- ☆15Updated 2 years ago
- Example showing how to do inference on a video file with Roboflow Infer☆49Updated 2 years ago
- Alternative version of st.camera_input which returns the webcam images live, without any button press needed☆38Updated 6 months ago
- Gaze estimation from 2D image☆12Updated last year
- Intuitive graphical representation of source code☆14Updated 2 years ago