Alternatives and similar repositories for RTX-AI-Toolkit

Users that are interested in RTX-AI-Toolkit are comparing it to the libraries listed below

• NVIDIA / workbench-example-sdxl-customization
  An NVIDIA AI Workbench example project for customizing an SDXL model
  ☆52Updated last month
• NVIDIA / workbench-example-hybrid-rag
  An NVIDIA AI Workbench example project for Retrieval Augmented Generation (RAG)
  ☆326Updated last month
• NVIDIA / trt-llm-as-openai-windows
  This reference can be used with any existing OpenAI integrated apps to run with TRT-LLM inference locally on GeForce GPU on Windows inste…
  ☆122Updated last year
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆187Updated this week
• NVIDIA / nim-anywhere
  Accelerate your Gen AI with NVIDIA NIM and NVIDIA AI Workbench
  ☆174Updated 2 months ago
• NVIDIA / workbench-example-nemotron-finetune
  An NVIDIA AI Workbench example project for fine-tuning a Nemotron-3 8B model
  ☆50Updated last year
• nomic-ai / llama.cpp
  llama.cpp fork used by GPT4All
  ☆56Updated 4 months ago
• NVIDIA / workbench-llamafactory
  This is an NVIDIA AI Workbench example project that demonstrates an end-to-end model development workflow using Llamafactory.
  ☆61Updated 9 months ago
• menloresearch / cortex.tensorrt-llm
  Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU a…
  ☆43Updated 9 months ago
• AK391 / gemini-gradio
  ☆95Updated 6 months ago
• microsoft / GRIN-MoE
  GRadient-INformed MoE
  ☆263Updated 9 months ago
• ThetaCursed / clean-ui
  Simple UI for Llama-3.2-11B-Vision & Molmo-7B-D
  ☆136Updated 9 months ago
• unslothai / unsloth-studio
  Unsloth Studio
  ☆93Updated 3 months ago
• langchain-ai / langchain-nvidia
  ☆159Updated 3 weeks ago
• bhimrazy / chat-with-phi-3-vision
  Chat with Phi 3.5/3 Vision LLMs. Phi-3.5-vision is a lightweight, state-of-the-art open multimodal model built upon datasets which includ…
  ☆33Updated 6 months ago
• transformerlab / transformerlab-api
  API Server for Transformer Lab
  ☆68Updated this week
• google-ai-edge / LiteRT-LM
  ☆267Updated this week
• severian42 / MoA-Ollama-Chat
  This is the Mixture-of-Agents (MoA) concept, adapted from the original work by TogetherAI. My version is tailored for local model usage a…
  ☆117Updated last year
• Aesthisia / LLMinator
  Gradio based tool to run opensource LLM models directly from Huggingface
  ☆93Updated last year
• PKU-YuanGroup / LLaVA-o1
  ☆56Updated 7 months ago
• SystemPanic / vllm-windows
  A high-throughput and memory-efficient inference and serving engine for LLMs (Windows build & kernels)
  ☆93Updated 3 weeks ago
• NVIDIA / workbench-example-agentic-rag
  An NVIDIA AI Workbench example project for an Agentic Retrieval Augmented Generation (RAG)
  ☆87Updated last month
• ibm-granite / granite-3.0-language-models
  ☆259Updated 3 weeks ago
• the-crypt-keeper / tcurtsni
  Tcurtsni: Reverse Instruction Chat, ever wonder what your LLM wants to ask you?
  ☆22Updated last year
• QuixiAI / kraken
  ☆66Updated last year
• AlexBodner / How_Much_VRAM
  ☆101Updated 10 months ago
• LAION-AI / Desktop_BUD-E
  BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…
  ☆36Updated 11 months ago
• marc-shade / Ollama-Workbench
  A comprehensive platform for managing, testing, and leveraging Ollama AI models with advanced features for customization, workflow automa…
  ☆48Updated 4 months ago
• grctest / Electron-BitNet
  Running Microsoft's BitNet via Electron, React & Astro
  ☆43Updated last month
• chigkim / Ollama-MMLU-Pro
  ☆95Updated 6 months ago