mzbac / GPTQ-for-LLaMa-API
Provide a way to use the GPT-QLLama model as an API
☆43Updated last year
Alternatives and similar repositories for GPTQ-for-LLaMa-API:
Users that are interested in GPTQ-for-LLaMa-API are comparing it to the libraries listed below
- A Personalised AI Assistant Inspired by 'Diamond Age, Powered by SMS☆92Updated last year
- Harnessing the Memory Power of the Camelids☆146Updated last year
- Conduct consumer interviews with synthetic focus groups using LLMs and LangChain☆43Updated last year
- Creates an Langchain Agent which uses the WebUI's API and Wikipedia to work☆74Updated last year
- Roy: A lightweight, model-agnostic framework for crafting advanced multi-agent systems using large language models.☆78Updated last year
- ☆136Updated last year
- A simple experiment on letting two local LLM have a conversation about anything!☆104Updated 8 months ago
- This code implements a Local LLM Selector from the list of Local Installed Ollama LLMs for your specific user Query☆102Updated last year
- Client-side toolkit for using large language models, including where self-hosted☆105Updated 3 months ago
- An Extension for oobabooga/text-generation-webui☆36Updated last year
- Deploy your GGML models to HuggingFace Spaces with Docker and gradio☆36Updated last year
- Local LLM ReAct Agent with Guidance☆156Updated last year
- A langchain app to visualise a debate using Tree-of-Thought reasoning☆59Updated last year
- Reinforcement Learning with Heuristic Imperatives - Finetuning LLMs for Post-Conventional Moral Intuition☆64Updated last year
- A langchain based tool to allow agents to dynamically create, use, store, and retrieve tools to solve real world problems☆126Updated last year
- ☆41Updated last year
- Porting BabyAGI to Oobabooba.☆33Updated last year
- oobaboga -text-generation-webui implementation of wafflecomposite - langchain-ask-pdf-local☆69Updated last year
- ☆86Updated last year
- Simple and fast server for GPTQ-quantized LLaMA inference☆24Updated last year
- ☆64Updated 3 months ago
- BabyAGI-🦙: Enhanced for Llama models (running 100% local) and persistent memory, with smart internet search based on BabyCatAGI and docu…☆89Updated last year
- ☆69Updated 6 months ago
- An Autonomous LLM Agent that runs on Wizcoder-15B☆336Updated 4 months ago
- ☆35Updated last year
- BabyAGI to run with locally hosted models using the API from https://github.com/oobabooga/text-generation-webui☆88Updated last year
- 🔓 The open-source autonomous agent LLM initiative 🔓☆91Updated last year
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆123Updated last year
- All the world is a play, we are but actors in it.☆47Updated this week
- A guidance compatibility layer for llama-cpp-python☆34Updated last year