Alternatives and similar repositories for RTX-AI-Toolkit:

Users that are interested in RTX-AI-Toolkit are comparing it to the libraries listed below

• NVIDIA / trt-llm-as-openai-windows
  This reference can be used with any existing OpenAI integrated apps to run with TRT-LLM inference locally on GeForce GPU on Windows inste…
  ☆119Updated 11 months ago
• NVIDIA / workbench-example-sdxl-customization
  An NVIDIA AI Workbench example project for customizing an SDXL model
  ☆45Updated 3 months ago
• NVIDIA / workbench-example-hybrid-rag
  An NVIDIA AI Workbench example project for Retrieval Augmented Generation (RAG)
  ☆302Updated 2 months ago
• NVIDIA / workbench-llamafactory
  This is an NVIDIA AI Workbench example project that demonstrates an end-to-end model development workflow using Llamafactory.
  ☆46Updated 4 months ago
• janhq / cortex.tensorrt-llm
  Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU a…
  ☆42Updated 4 months ago
• langchain-ai / langchain-nvidia
  ☆134Updated last week
• nomic-ai / llama.cpp
  llama.cpp fork used by GPT4All
  ☆51Updated last week
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆154Updated this week
• NVIDIA / nim-anywhere
  Accelerate your Gen AI with NVIDIA NIM and NVIDIA AI Workbench
  ☆146Updated 3 weeks ago
• NVIDIA / workbench-example-agentic-rag
  An NVIDIA AI Workbench example project for an Agentic Retrieval Augmented Generation (RAG)
  ☆58Updated 2 weeks ago
• NVIDIA / workbench-example-mistral-finetune
  An NVIDIA AI Workbench example project for fine-tuning a Mistral 7B model
  ☆53Updated 8 months ago
• run-ai / runai-model-streamer
  ☆159Updated this week
• tdrussell / qlora-pipe
  A pipeline parallel training script for LLMs.
  ☆122Updated 3 weeks ago
• Aesthisia / LLMinator
  Gradio based tool to run opensource LLM models directly from Huggingface
  ☆91Updated 7 months ago
• bhimrazy / chat-with-phi-3-vision
  Chat with Phi 3.5/3 Vision LLMs. Phi-3.5-vision is a lightweight, state-of-the-art open multimodal model built upon datasets which includ…
  ☆33Updated last month
• NVIDIA / metropolis-nim-workflows
  Collection of reference workflows for building intelligent agents with NIMs
  ☆146Updated last month
• dusty-nv / NanoDB
  Zero-copy multimodal vector DB with CUDA and CLIP/SigLIP
  ☆46Updated 8 months ago
• cognitivecomputations / generate
  ☆28Updated 11 months ago
• the-crypt-keeper / tcurtsni
  Tcurtsni: Reverse Instruction Chat, ever wonder what your LLM wants to ask you?
  ☆22Updated 7 months ago
• GaiZhenbiao / Phi3V-Finetuning
  Parameter-efficient finetuning script for Phi-3-vision, the strong multimodal language model by Microsoft.
  ☆57Updated 8 months ago
• PKU-YuanGroup / LLaVA-o1
  ☆53Updated 3 months ago
• intel / auto-round
  Advanced Quantization Algorithm for LLMs/VLMs.
  ☆372Updated this week
• cognitivecomputations / kraken
  ☆65Updated 8 months ago
• adithya-s-k / YoloGemma
  Testing and evaluating the capabilities of Vision-Language models (PaliGemma) in performing computer vision tasks such as object detectio…
  ☆80Updated 8 months ago
• neuralmagic / guidellm
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
  ☆191Updated this week
• l4b4r4b4b4 / AIDocks
  LLM-Training-API: Including Embeddings & ReRankers, mergekit, LaserRMT
  ☆26Updated last year
• LLM360 / amber-data-prep
  Data preparation code for Amber 7B LLM
  ☆85Updated 9 months ago
• cfahlgren1 / observers
  A Lightweight Library for AI Observability
  ☆233Updated this week
• NVIDIA-AI-Blueprints / digital-human
  NVIDIA AI Blueprint for digital human for customer service.
  ☆222Updated last week