Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.
☆91Jun 19, 2023Updated 2 years ago
Alternatives and similar repositories for AutoGPTQ-API
Users that are interested in AutoGPTQ-API are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Visual Studio Code extension for WizardCoder☆148Aug 1, 2023Updated 2 years ago
- A script for merging a LLM model and a LoRA☆13Jun 22, 2023Updated 2 years ago
- This python script uses OpenAI API Text To Speech TTS Voice to convert Epub books to Audiobooks with ability to save progress and resume …☆17Nov 8, 2024Updated last year
- An Extension for oobabooga/text-generation-webui☆37Jul 15, 2023Updated 2 years ago
- ☆13Oct 22, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A small standalone flask python server for llama.cpp that acts like a KoboldAI api.☆14May 20, 2023Updated 3 years ago
- A KoboldAI-like memory extension for oobabooga's text-generation-webui☆108Oct 29, 2024Updated last year
- Creates an Langchain Agent which uses the WebUI's API and Wikipedia to work☆73Sep 12, 2023Updated 2 years ago
- Oobabooga "Hello World" API example for node.js with Express☆13Jul 2, 2023Updated 2 years ago
- Docker images and configuration to run text-generation-webui with GPU or CPU support☆32Mar 19, 2024Updated 2 years ago
- ☆28Aug 30, 2023Updated 2 years ago
- Text WebUI extension to add clever Notebooks to Chat mode☆148Aug 7, 2025Updated 9 months ago
- A web-app to explore topics using LLM (less typing and more clicks)☆67Mar 15, 2026Updated 2 months ago
- Python examples using the bigcode/tiny_starcoder_py 159M model to generate code☆45May 31, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Personal voice assistant, with voice interruption and Twilio support☆18Feb 24, 2025Updated last year
- An autonomous AI agent extension for Oobabooga's web ui☆171Sep 7, 2023Updated 2 years ago
- 基于RWKV模型的角色扮演，实际上是个改的妈都不认识的 RWKV_Role_Playing☆17Aug 17, 2023Updated 2 years ago
- AI-powered task management system template w/ free storage use☆41Apr 17, 2023Updated 3 years ago
- Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…☆145Oct 17, 2023Updated 2 years ago
- Cross-GPU KV Cache Marketplace☆22Nov 12, 2025Updated 6 months ago
- An Autonomous LLM Agent that runs on Wizcoder-15B☆336Oct 21, 2024Updated last year
- ☆12Apr 4, 2024Updated 2 years ago
- A plugin for Oobabooga TextUI that allows you to search multiple search engines. Initially we're using Google API or DuckDuckGo.☆17Jun 4, 2023Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Friendly Terminal Assistant for Developers☆17Mar 23, 2024Updated 2 years ago
- A Python-based chatbot project built on the autogen and tinygrad foundation, utilizing advanced agents for dynamic conversations and func…☆27Oct 9, 2024Updated last year
- ☆15Sep 23, 2024Updated last year
- RUN LLAMA-3 70B llm with NVIDIA endpoints☆14Apr 20, 2024Updated 2 years ago
- A small function for converting HTML to Markdown.☆15Sep 24, 2023Updated 2 years ago
- LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath☆9,480Jun 7, 2025Updated 11 months ago
- ☆74Sep 5, 2023Updated 2 years ago
- run ollama & gguf easily with a single command☆52May 15, 2024Updated 2 years ago
- ☆22Jun 13, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆11Mar 6, 2024Updated 2 years ago
- Guaranty the output of an LLM to follow a json schema.☆25Dec 6, 2023Updated 2 years ago
- PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-t…☆30May 21, 2024Updated 2 years ago
- Modified Beam Search with periodical restart☆12Sep 12, 2024Updated last year
- ☆41Nov 30, 2023Updated 2 years ago
- This repository contains Python code to Download Historical Stocks data and Intraday Options data without any cost, Extraction from Zerod…☆25Mar 28, 2026Updated last month
- ☆10Jun 28, 2024Updated last year