Alternatives and similar repositories for ChatRTX:

Users that are interested in ChatRTX are comparing it to the libraries listed below

• dvmazur / mixtral-offloading
  Run Mixtral-8x7B models in Colab or consumer desktops
  ☆2,297Updated 11 months ago
• bigcode-project / starcoder2
  Home of StarCoder2!
  ☆1,894Updated last year
• intel / intel-extension-for-transformers
  ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Pl…
  ☆2,164Updated 5 months ago
• huggingface / optimum-nvidia
  ☆943Updated last month
• NVIDIA / TensorRT-LLM
  TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain…
  ☆9,975Updated this week
• huggingface / text-generation-inference
  Large Language Model Text Generation Inference
  ☆9,941Updated this week
• ml-explore / mlx-examples
  Examples in the MLX framework
  ☆7,215Updated this week
• metavoiceio / metavoice-src
  Foundational model for human-like, expressive TTS
  ☆4,076Updated 8 months ago
• turboderp-org / exllamav2
  A fast inference library for running LLMs locally on modern consumer-class GPUs
  ☆4,078Updated 2 weeks ago
• Vahe1994 / AQLM
  Official Pytorch repository for Extreme Compression of Large Language Models via Additive Quantization https://arxiv.org/pdf/2401.06118.p…
  ☆1,228Updated 3 weeks ago
• AnswerDotAI / fsdp_qlora
  Training LLMs with QLoRA + FSDP
  ☆1,467Updated 4 months ago
• microsoft / promptbase
  All things prompt engineering
  ☆5,583Updated 9 months ago
• OpenCodeInterpreter / OpenCodeInterpreter
  OpenCodeInterpreter is a suite of open-source code generation systems aimed at bridging the gap between large language models and sophist…
  ☆1,637Updated 10 months ago
• arcee-ai / mergekit
  Tools for merging pretrained large language models.
  ☆5,478Updated this week
• SJTU-IPADS / PowerInfer
  High-speed Large Language Model Serving for Local Deployment
  ☆8,169Updated last month
• NVIDIA / GenerativeAIExamples
  Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.
  ☆2,956Updated last week
• b4rtaz / distributed-llama
  Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
  ☆1,993Updated last week
• microsoft / onnxruntime-genai
  Generative AI extensions for onnxruntime
  ☆665Updated this week
• pytorch-labs / gpt-fast
  Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.
  ☆5,898Updated 2 weeks ago
• 01-ai / Yi
  A series of large language models trained from scratch by developers @01-ai
  ☆7,832Updated 4 months ago
• openai / simple-evals
  ☆2,475Updated last week
• AutoGPTQ / AutoGPTQ
  An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
  ☆4,769Updated last week
• aixcoder-plugin / aiXcoder-7B
  official repository of aiXcoder-7B Code Large Language Model
  ☆2,255Updated 2 months ago
• agiresearch / AIOS
  AIOS: AI Agent Operating System
  ☆3,992Updated last week
• meta-llama / PurpleLlama
  Set of tools to assess and improve LLM security.
  ☆2,983Updated last month
• microsoft / Olive
  Olive: Simplify ML Model Finetuning, Conversion, Quantization, and Optimization for CPUs, GPUs and NPUs.
  ☆1,849Updated this week
• GoogleCloudPlatform / localllm
  ☆1,537Updated 11 months ago
• apple / ml-ferret
  ☆8,606Updated 5 months ago
• ise-uiuc / magicoder
  [ICML'24] Magicoder: Empowering Code Generation with OSS-Instruct
  ☆2,003Updated 4 months ago
• cohere-ai / cohere-toolkit
  Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.
  ☆3,014Updated 2 weeks ago