Alternatives and similar repositories for ChatRTX

Users that are interested in ChatRTX are comparing it to the libraries listed below

• NVIDIA / GenerativeAIExamples
  Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.
  ☆3,665Updated last week
• huggingface / optimum-nvidia
  ☆1,015Updated 10 months ago
• cohere-ai / cohere-toolkit
  Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.
  ☆3,152Updated last week
• GoogleCloudPlatform / localllm
  ☆1,551Updated last year
• bigcode-project / starcoder2
  Home of StarCoder2!
  ☆2,008Updated last year
• janhq / cortex.cpp
  Local AI API Platform
  ☆2,764Updated 5 months ago
• NVIDIA / TensorRT-LLM
  TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizat…
  ☆12,385Updated last week
• lmstudio-ai / model-catalog
  A collection of standardized JSON descriptors for Large Language Model (LLM) files.
  ☆799Updated last year
• microsoft / vscode-ai-toolkit
  ☆1,845Updated last week
• lmstudio-ai / lms
  LM Studio CLI
  ☆3,969Updated this week
• Stability-AI / StableCascade
  Official Code for Stable Cascade
  ☆6,588Updated last year
• turboderp-org / exllamav2
  A fast inference library for running LLMs locally on modern consumer-class GPUs
  ☆4,388Updated last week
• Vahe1994 / AQLM
  Official Pytorch repository for Extreme Compression of Large Language Models via Additive Quantization https://arxiv.org/pdf/2401.06118.p…
  ☆1,309Updated 4 months ago
• imoneoi / openchat
  OpenChat: Advancing Open-source Language Models with Imperfect Data
  ☆5,461Updated last year
• intel / intel-extension-for-transformers
  ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Pl…
  ☆2,170Updated last year
• a-real-ai / pywinassistant
  The first open-source Artificial Narrow Intelligence generalist agentic framework Computer-Using-Agent that fully operates graphical-user…
  ☆1,313Updated 10 months ago
• google / gemma.cpp
  lightweight, standalone C++ inference engine for Google's Gemma models.
  ☆6,643Updated this week
• OpenGenerativeAI / llm-colosseum
  Benchmark LLMs by fighting in Street Fighter 3! The new way to evaluate the quality of an LLM
  ☆1,456Updated 8 months ago
• pytorch / torchchat
  Run PyTorch LLMs locally on servers, desktop and mobile
  ☆3,624Updated 3 months ago
• mistralai / mistral-inference
  Official inference library for Mistral models
  ☆10,600Updated 3 weeks ago
• google-deepmind / gemma
  Gemma open-weight LLM library, from Google DeepMind
  ☆3,879Updated last month
• google / gemma_pytorch
  The official PyTorch implementation of Google's Gemma models
  ☆5,586Updated 6 months ago
• MDK8888 / GPTFast
  Accelerate your Hugging Face Transformers 7.6-9x. Native to Hugging Face and PyTorch.
  ☆686Updated last year
• LargeWorldModel / LWM
  Large World Model -- Modeling Text and Video with Millions Context
  ☆7,383Updated last year
• McGill-NLP / webllama
  Llama-3 agents that can browse the web by following instructions and talking to you
  ☆1,407Updated last year
• jacoblee93 / fully-local-pdf-chatbot
  Yes, it's another chat over documents implementation... but this one is entirely local!
  ☆1,809Updated 2 weeks ago
• developersdigest / llm-answer-engine
  Perplexity Inspired Answer Engine
  ☆5,009Updated 5 months ago
• AnswerDotAI / fsdp_qlora
  Training LLMs with QLoRA + FSDP
  ☆1,534Updated last year
• predibase / lorax
  Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
  ☆3,568Updated 6 months ago
• tairov / llama2.mojo
  Inference Llama 2 in one file of pure 🔥
  ☆2,115Updated 2 weeks ago