mzbac / GPTQ-for-LLaMa-API
Provide a way to use the GPT-QLLama model as an API
☆43Updated last year
Alternatives and similar repositories for GPTQ-for-LLaMa-API:
Users that are interested in GPTQ-for-LLaMa-API are comparing it to the libraries listed below
- A Personalised AI Assistant Inspired by 'Diamond Age, Powered by SMS☆92Updated last year
- Conduct consumer interviews with synthetic focus groups using LLMs and LangChain☆43Updated last year
- ☆41Updated last year
- ☆37Updated last year
- oobaboga -text-generation-webui implementation of wafflecomposite - langchain-ask-pdf-local☆69Updated last year
- BabyAGI-🦙: Enhanced for Llama models (running 100% local) and persistent memory, with smart internet search based on BabyCatAGI and docu…☆89Updated last year
- LUI: Autonomous Collective Decision Making via Large Language Models☆104Updated last year
- Build your Swarm of Internet Agents using MultiOn 🚀☆76Updated last year
- Example of calling OpenRouter from a Streamit app☆94Updated last year
- Creates an Langchain Agent which uses the WebUI's API and Wikipedia to work☆72Updated last year
- A guidance compatibility layer for llama-cpp-python☆34Updated last year
- Client-side toolkit for using large language models, including where self-hosted☆104Updated 2 months ago
- Reinforcement Learning with Heuristic Imperatives - Finetuning LLMs for Post-Conventional Moral Intuition☆64Updated last year
- SmartGPT is a Node.js webpage implementation of a dynamic prompting system, inspired by [AI Explained](https://www.youtube.com/@ai-explai…☆64Updated 9 months ago
- A simple experiment on letting two local LLM have a conversation about anything!☆101Updated 6 months ago
- All the world is a play, we are but actors in it.☆47Updated this week
- 100% Private & Simple. OSS 🐍 Code Interpreter for LLMs 🦙☆34Updated last year
- Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.☆91Updated last year
- AgentX is an experiment to develop autonomous agents so you can automate everything! This project is inspired by Auto-GPT, babyagi, Super…☆98Updated last year
- 🔓 The open-source autonomous agent LLM initiative 🔓☆90Updated 11 months ago
- ☆87Updated last year
- Simple and fast server for GPTQ-quantized LLaMA inference☆24Updated last year
- ☆136Updated last year
- Local LLM ReAct Agent with Guidance☆156Updated last year
- An open source ChatGPT UI taken from Chatbot UI and combined with LangChain-python based backend served using Lanarky.☆37Updated last year
- Porting BabyAGI to Oobabooba.☆33Updated last year
- This code implements a Local LLM Selector from the list of Local Installed Ollama LLMs for your specific user Query☆101Updated last year
- Deploy your GGML models to HuggingFace Spaces with Docker and gradio☆36Updated last year
- An implementation of long term memory and external tools for LLMs☆71Updated last year
- AutoNL - Natural Language Automation tool☆85Updated 10 months ago