Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.
☆90Jun 19, 2023Updated 2 years ago
Alternatives and similar repositories for AutoGPTQ-API
Users that are interested in AutoGPTQ-API are comparing it to the libraries listed below
Sorting:
- Visual Studio Code extension for WizardCoder☆149Aug 1, 2023Updated 2 years ago
- This python script uses OpenAI API Text To Speech TTS Voice to convert Epub books to Audiobooks with ability to save progress and resume …☆17Nov 8, 2024Updated last year
- A Python-based chatbot project built on the autogen and tinygrad foundation, utilizing advanced agents for dynamic conversations and func…☆27Oct 9, 2024Updated last year
- AI-powered task management system template w/ free storage use☆42Apr 17, 2023Updated 2 years ago
- Android app that helps you copy text from images.☆13May 20, 2022Updated 3 years ago
- ☆13Oct 22, 2023Updated 2 years ago
- Creates an Langchain Agent which uses the WebUI's API and Wikipedia to work☆73Sep 12, 2023Updated 2 years ago
- Oobabooga "Hello World" API example for node.js with Express☆13Jul 2, 2023Updated 2 years ago
- ☆12Apr 4, 2024Updated last year
- RUN LLAMA-3 70B llm with NVIDIA endpoints☆14Apr 20, 2024Updated last year
- A script for merging a LLM model and a LoRA☆13Jun 22, 2023Updated 2 years ago
- A React.JS + Tachyons component library.☆11Aug 20, 2017Updated 8 years ago
- An autonomous AI agent extension for Oobabooga's web ui☆173Sep 7, 2023Updated 2 years ago
- 100% Private & Simple. OSS 🐍 Code Interpreter for LLMs 🦙☆34Aug 29, 2023Updated 2 years ago
- Cross-GPU KV Cache Marketplace☆23Nov 12, 2025Updated 3 months ago
- Open-source coding assistant for Visual Studio Code. Connect to LLMs from OpenAI or Google.☆18Aug 14, 2023Updated 2 years ago
- A KoboldAI-like memory extension for oobabooga's text-generation-webui☆108Oct 29, 2024Updated last year
- Text WebUI extension to add clever Notebooks to Chat mode☆145Aug 7, 2025Updated 6 months ago
- An LLM-powered self-studying app using retrieval-augmented generation prompting | Streamlit LLM Hackathon 2023☆17Oct 6, 2023Updated 2 years ago
- Open Server is an OpenAI API Compatible Server for generating text, images, embeddings, and storing them in vector databases. It also inc…☆17Dec 8, 2023Updated 2 years ago
- A web-app to explore topics using LLM (less typing and more clicks)☆68Feb 6, 2026Updated 3 weeks ago
- A Python package that creates user interfaces (websites and desktop apps) from HTML easily.☆14May 21, 2024Updated last year
- Personal voice assistant, with voice interruption and Twilio support☆18Feb 24, 2025Updated last year
- A web site/blog builder, implemented as a wrapper around org-project.☆17Sep 20, 2021Updated 4 years ago
- SQL functions for calling OpenAI APIs☆22Jan 14, 2023Updated 3 years ago
- Python examples using the bigcode/tiny_starcoder_py 159M model to generate code☆45May 31, 2023Updated 2 years ago
- ☆23Jun 13, 2024Updated last year
- Datasette enrichment for analyzing row data using OpenAI's GPT models☆22May 15, 2024Updated last year
- ☆74Sep 5, 2023Updated 2 years ago
- Guaranty the output of an LLM to follow a json schema.☆25Dec 6, 2023Updated 2 years ago
- The Personal Voice Assistant is a sophisticated AI-driven tool designed to interact with users through natural language. Leveraging a sta…☆24Aug 4, 2024Updated last year
- run ollama & gguf easily with a single command☆52May 15, 2024Updated last year
- Demo of an "always-on" AI assistant.☆24Feb 14, 2024Updated 2 years ago
- Run Orpheus 3B Locally with Gradio UI, Standalone App☆23Apr 1, 2025Updated 11 months ago
- Docker images and configuration to run text-generation-webui with GPU or CPU support☆32Mar 19, 2024Updated last year
- ☆30Nov 11, 2023Updated 2 years ago
- With just Llama-2, generate full React codebases from a single prompt☆103Aug 25, 2023Updated 2 years ago
- LIVA - Local Intelligent Voice Assistant☆61Aug 28, 2024Updated last year
- Discord chatbot interface to train an LLM on user message history☆27Jun 9, 2023Updated 2 years ago