serp-ai / ChatLLaMA-and-ChatGPT-Desktop-App

A desktop application written in PyQT5 (python). Has support for using openai chatGPT as well as using a locally running llama model. Local has support for inferencing in 8-bit as well as 4/3/2 bit inferencing (model must already be quantized).
76Updated last year

Alternatives and similar repositories for ChatLLaMA-and-ChatGPT-Desktop-App:

Users that are interested in ChatLLaMA-and-ChatGPT-Desktop-App are comparing it to the libraries listed below