Alternatives and similar repositories for RTX-AI-Toolkit

Users that are interested in RTX-AI-Toolkit are comparing it to the libraries listed below

• NVIDIA / workbench-example-sdxl-customization
  An NVIDIA AI Workbench example project for customizing an SDXL model
  ☆55Updated 2 months ago
• NVIDIA / trt-llm-as-openai-windows
  This reference can be used with any existing OpenAI integrated apps to run with TRT-LLM inference locally on GeForce GPU on Windows inste…
  ☆127Updated last year
• nomic-ai / llama.cpp
  llama.cpp fork used by GPT4All
  ☆56Updated 6 months ago
• NVIDIA / workbench-example-nemotron-finetune
  An NVIDIA AI Workbench example project for fine-tuning a Nemotron-3 8B model
  ☆51Updated last year
• NVIDIA / nim-anywhere
  Accelerate your Gen AI with NVIDIA NIM and NVIDIA AI Workbench
  ☆180Updated 3 months ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆196Updated this week
• NVIDIA / workbench-example-hybrid-rag
  An NVIDIA AI Workbench example project for Retrieval Augmented Generation (RAG)
  ☆339Updated 2 weeks ago
• langchain-ai / langchain-nvidia
  ☆162Updated this week
• menloresearch / cortex.tensorrt-llm
  Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU a…
  ☆43Updated 11 months ago
• NVIDIA / workbench-example-mistral-finetune
  An NVIDIA AI Workbench example project for fine-tuning a Mistral 7B model
  ☆60Updated last year
• marklysze / LlamaIndex-RAG-WSL-CUDA
  Examples of RAG using Llamaindex with local LLMs - Gemma, Mixtral 8x7B, Llama 2, Mistral 7B, Orca 2, Phi-2, Neural 7B
  ☆129Updated last year
• NVIDIA / workbench-llamafactory
  This is an NVIDIA AI Workbench example project that demonstrates an end-to-end model development workflow using Llamafactory.
  ☆64Updated 10 months ago
• ThetaCursed / clean-ui
  Simple UI for Llama-3.2-11B-Vision & Molmo-7B-D
  ☆137Updated 10 months ago
• NVIDIA-AI-Blueprints / video-search-and-summarization
  Blueprint for Ingesting massive volumes of live or archived videos and extract insights for summarization and interactive Q&A
  ☆211Updated last week
• unslothai / unsloth-studio
  Unsloth Studio
  ☆101Updated 4 months ago
• NVlabs / Jet-Nemotron
  ☆403Updated this week
• Aesthisia / LLMinator
  Gradio based tool to run opensource LLM models directly from Huggingface
  ☆94Updated last year
• google-ai-edge / LiteRT-LM
  ☆311Updated this week
• NVIDIA-AI-Blueprints / ai-virtual-assistant
  Customizable, AI-driven virtual assistant designed to streamline customer service operations, handle common inquiries, and improve overal…
  ☆174Updated last month
• the-crypt-keeper / tcurtsni
  Tcurtsni: Reverse Instruction Chat, ever wonder what your LLM wants to ask you?
  ☆22Updated last year
• AK391 / gemini-gradio
  ☆95Updated 8 months ago
• dusty-nv / NanoLLM
  Optimized local inference for LLMs with HuggingFace-like APIs for quantization, vision/language models, multimodal agents, speech, vector…
  ☆309Updated 10 months ago
• AlexBodner / How_Much_VRAM
  ☆102Updated 11 months ago
• remichu-ai / gallama
  ☆132Updated 4 months ago
• chigkim / Ollama-MMLU-Pro
  ☆95Updated last week
• NVIDIA / G-Assist
  Help shape the future of Project G-Assist
  ☆161Updated 2 months ago
• stringandstickytape / MaxsAiStudio
  A Windows tool to query various LLM AIs. Supports branched conversations, history and summaries among others.
  ☆33Updated last week
• akx / ggify
  Tool to download models from Huggingface Hub and convert them to GGML/GGUF for llama.cpp
  ☆158Updated 4 months ago
• RandomInternetPreson / Lucid_Vision
  This extension enhances the capabilities of textgen-webui by integrating advanced vision models, allowing users to have contextualized co…
  ☆57Updated 10 months ago
• anastasiosyal / phi4-multimodal-instruct-server
  Phi4 Multimodal Instruct - OpenAI endpoint and Docker Image for self-hosting
  ☆39Updated 5 months ago