seonglae / llama2gptq

Chat to LLaMa 2 that also provides responses with reference documents over vector database. Locally available model using GPTQ 4bit quantization.
30Updated 11 months ago

Related projects

Alternatives and complementary repositories for llama2gptq