NVIDIA / RTX-AI-Toolkit
The NVIDIA RTX™ AI Toolkit is a suite of tools and SDKs for Windows developers to customize, optimize, and deploy AI models across RTX PCs and cloud.
☆115Updated this week
Related projects ⓘ
Alternatives and complementary repositories for RTX-AI-Toolkit
- This reference can be used with any existing OpenAI integrated apps to run with TRT-LLM inference locally on GeForce GPU on Windows inste…☆116Updated 8 months ago
- automatically quant GGUF models☆140Updated this week
- This is an NVIDIA AI Workbench example project that demonstrates an end-to-end model development workflow using Llamafactory.☆37Updated last month
- Chat with Phi 3.5/3 Vision LLMs. Phi-3.5-vision is a lightweight, state-of-the-art open multimodal model built upon datasets which includ…☆32Updated 2 months ago
- An NVIDIA AI Workbench example project for customizing an SDXL model☆42Updated 3 weeks ago
- Fast Real-time Object Detection with High-Res Output https://x.com/_akhaliq/status/1840213012818329826☆52Updated last month
- ☆55Updated this week
- ☆120Updated this week
- NVIDIA AI Blueprint for digital human for customer service.☆131Updated this week
- ☆35Updated last year
- Use Florence 2 to auto-label data for use in training fine-tuned object detection models.☆59Updated 3 months ago
- Framework agnostic computer vision inference. Run 1000+ models by changing only one line of code. Supports models from transformers, timm…☆121Updated this week
- Testing the different LLM and RAG Tests while I learn along the way☆17Updated 2 months ago
- GPT-4 Level Conversational QA Trained In a Few Hours☆55Updated 3 months ago
- Fast approximate inference on a single GPU with sparsity aware offloading☆38Updated 10 months ago
- All the world is a play, we are but actors in it.☆47Updated 4 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆25Updated 8 months ago
- prime is a framework for efficient, globally distributed training of AI models over the internet.☆212Updated this week
- Gradio based tool to run opensource LLM models directly from Huggingface☆87Updated 4 months ago
- ☆39Updated 9 months ago
- Testing and evaluating the capabilities of Vision-Language models (PaliGemma) in performing computer vision tasks such as object detectio…☆77Updated 5 months ago
- An all-new Language Model That Processes Ultra-Long Sequences of 100,000+ Ultra-Fast☆137Updated 2 months ago
- Collection of reference workflows for building intelligent agents with NIMs☆114Updated this week
- Official homepage for "Self-Harmonized Chain of Thought"☆83Updated 2 months ago
- A list of language models with permissive licenses such as MIT or Apache 2.0☆24Updated 2 weeks ago
- LLM finetuned for generating symbolic music☆33Updated 2 months ago
- Optimized local inference for LLMs with HuggingFace-like APIs for quantization, vision/language models, multimodal agents, speech, vector…☆197Updated last month
- Video+code lecture on building nanoGPT from scratch☆64Updated 5 months ago
- ☆94Updated 2 months ago
- Data preparation code for Amber 7B LLM☆83Updated 6 months ago