Alternatives and similar repositories for RTX-AI-Toolkit

Users that are interested in RTX-AI-Toolkit are comparing it to the libraries listed below

• NVIDIA / workbench-example-sdxl-customization
  An NVIDIA AI Workbench example project for customizing an SDXL model
  ☆57Updated 2 weeks ago
• NVIDIA / trt-llm-as-openai-windows
  This reference can be used with any existing OpenAI integrated apps to run with TRT-LLM inference locally on GeForce GPU on Windows inste…
  ☆127Updated last year
• NVIDIA / workbench-llamafactory
  This is an NVIDIA AI Workbench example project that demonstrates an end-to-end model development workflow using Llamafactory.
  ☆67Updated last year
• NVIDIA / nim-anywhere
  Accelerate your Gen AI with NVIDIA NIM and NVIDIA AI Workbench
  ☆188Updated 6 months ago
• NVIDIA / workbench-example-nemotron-finetune
  An NVIDIA AI Workbench example project for fine-tuning a Nemotron-3 8B model
  ☆56Updated last year
• ThetaCursed / clean-ui
  Simple UI for Llama-3.2-11B-Vision & Molmo-7B-D
  ☆136Updated last year
• nomic-ai / llama.cpp
  llama.cpp fork used by GPT4All
  ☆56Updated 8 months ago
• NVIDIA / workbench-example-hybrid-rag
  An NVIDIA AI Workbench example project for Retrieval Augmented Generation (RAG)
  ☆344Updated 3 months ago
• NVIDIA-AI-Blueprints / ai-virtual-assistant
  Customizable, AI-driven virtual assistant designed to streamline customer service operations, handle common inquiries, and improve overal…
  ☆205Updated 4 months ago
• NVIDIA / workbench-example-mistral-finetune
  An NVIDIA AI Workbench example project for fine-tuning a Mistral 7B model
  ☆64Updated last year
• langchain-ai / langchain-nvidia
  ☆174Updated this week
• Aesthisia / LLMinator
  Gradio based tool to run opensource LLM models directly from Huggingface
  ☆96Updated last year
• grctest / Electron-BitNet
  Running Microsoft's BitNet via Electron, React & Astro
  ☆46Updated last month
• janhq / cortex.tensorrt-llm
  Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU a…
  ☆42Updated last year
• microsoft / GRIN-MoE
  GRadient-INformed MoE
  ☆264Updated last year
• transformerlab / transformerlab-api
  API Server for Transformer Lab
  ☆78Updated this week
• unslothai / unsloth-studio
  Unsloth Studio
  ☆116Updated 7 months ago
• AK391 / gemini-gradio
  ☆94Updated 11 months ago
• PKU-YuanGroup / LLaVA-o1
  ☆55Updated 11 months ago
• dusty-nv / NanoLLM
  Optimized local inference for LLMs with HuggingFace-like APIs for quantization, vision/language models, multimodal agents, speech, vector…
  ☆332Updated last year
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆214Updated 3 weeks ago
• jayrodge / Multimodal-RAG-with-Llama-3.2
  Multimodal AI agent with Llama 3.2: A Streamlit app that processes text, images, PDFs, and PPTs, integrating NIM microservices, Milvus, a…
  ☆134Updated last year
• Cerebras / DocChat
  GPT-4 Level Conversational QA Trained In a Few Hours
  ☆65Updated last year
• SakanaAI / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆34Updated last year
• anastasiosyal / phi4-multimodal-instruct-server
  Phi4 Multimodal Instruct - OpenAI endpoint and Docker Image for self-hosting
  ☆40Updated 8 months ago
• cfahlgren1 / webllm-playground
  Run LLMs in the Browser with MLC / WebLLM ✨
  ☆145Updated last year
• huseinzol05 / transformers-continuous-batching
  Lightweight continuous batching OpenAI compatibility using HuggingFace Transformers include T5 and Whisper.
  ☆29Updated 8 months ago
• AlexBodner / How_Much_VRAM
  ☆102Updated last year
• google-ai-edge / LiteRT-LM
  ☆477Updated this week
• NVIDIA / metropolis-nim-workflows
  Collection of reference workflows for building intelligent agents with NIMs
  ☆178Updated 10 months ago