mzbac / GPTQ-for-LLaMa-APILinks
Provide a way to use the GPT-QLLama model as an API
☆44Updated 2 years ago
Alternatives and similar repositories for GPTQ-for-LLaMa-API
Users that are interested in GPTQ-for-LLaMa-API are comparing it to the libraries listed below
Sorting:
- Harnessing the Memory Power of the Camelids☆146Updated last year
- A prompt/context management system☆170Updated 2 years ago
- An Autonomous LLM Agent that runs on Wizcoder-15B☆334Updated 9 months ago
- Load local LLMs effortlessly in a Jupyter notebook for testing purposes alongside Langchain or other agents. Contains Oobagooga and Kobol…☆214Updated 2 years ago
- Run Alpaca LLM in LangChain☆216Updated last year
- A Personalised AI Assistant Inspired by 'Diamond Age, Powered by SMS☆93Updated 2 years ago
- A discord bot that roleplays!☆149Updated last year
- Simple and fast server for GPTQ-quantized LLaMA inference