Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.
☆90Jun 19, 2023Updated 3 years ago
Alternatives and similar repositories for AutoGPTQ-API
Users that are interested in AutoGPTQ-API are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Visual Studio Code extension for WizardCoder☆147Aug 1, 2023Updated 3 years ago
- A script for merging a LLM model and a LoRA☆13Jun 22, 2023Updated 3 years ago
- This python script uses OpenAI API Text To Speech TTS Voice to convert Epub books to Audiobooks with ability to save progress and resume …☆17Nov 8, 2024Updated last year
- ☆13Oct 22, 2023Updated 2 years ago
- A KoboldAI-like memory extension for oobabooga's text-generation-webui☆108Oct 29, 2024Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A small standalone flask python server for llama.cpp that acts like a KoboldAI api.☆14May 20, 2023Updated 3 years ago
- 100% Private & Simple. OSS 🐍 Code Interpreter for LLMs 🦙☆34Aug 29, 2023Updated 3 years ago
- Creates an Langchain Agent which uses the WebUI's API and Wikipedia to work☆73Sep 12, 2023Updated 3 years ago
- Oobabooga "Hello World" API example for node.js with Express☆13Jul 2, 2023Updated 3 years ago
- ☆28Aug 30, 2023Updated 3 years ago
- Text WebUI extension to add clever Notebooks to Chat mode☆148Aug 7, 2025Updated last year
- Docker images and configuration to run text-generation-webui with GPU or CPU support☆31Mar 19, 2024Updated 2 years ago
- ☆15Feb 15, 2023Updated 3 years ago
- Personal voice assistant, with voice interruption and Twilio support☆18Feb 24, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- AI-powered task management system template w/ free storage use☆42Apr 17, 2023Updated 3 years ago
- Python examples using the bigcode/tiny_starcoder_py 159M model to generate code☆45May 31, 2023Updated 3 years ago
- 基于RWKV模型的角色扮演，实际上是个改的妈都不认识的 RWKV_Role_Playing☆17Aug 17, 2023Updated 3 years ago
- Android app that helps you copy text from images.☆13May 20, 2022Updated 4 years ago
- starcoder server for huggingface-vscdoe custom endpoint☆177Nov 18, 2023Updated 2 years ago
- Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…☆143Oct 17, 2023Updated 2 years ago
- An Autonomous LLM Agent that runs on Wizcoder-15B☆333Oct 21, 2024Updated last year
- Friendly Terminal Assistant for Developers☆17Mar 23, 2024Updated 2 years ago
- ☆17Sep 22, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A plugin for Oobabooga TextUI that allows you to search multiple search engines. Initially we're using Google API or DuckDuckGo.☆18Jun 4, 2023Updated 3 years ago
- A Python-based chatbot project built on the autogen and tinygrad foundation, utilizing advanced agents for dynamic conversations and func…☆27Oct 9, 2024Updated last year
- Open-source coding assistant for Visual Studio Code. Connect to LLMs from OpenAI or Google.☆18Aug 14, 2023Updated 3 years ago
- CodeUp: A Multilingual Code Generation Llama-X Model with Parameter-Efficient Instruction-Tuning☆127Dec 25, 2024Updated last year
- A Multi-Agentic AI Assistant/Builder☆28Jun 1, 2026Updated 3 months ago
- LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath☆9,478Jun 7, 2025Updated last year
- ☆21Jun 13, 2024Updated 2 years ago
- run ollama & gguf easily with a single command☆53May 15, 2024Updated 2 years ago
- Groquments is a simple demonstration project showcasing how easily PocketGroq can help developers integrate Groq's powerful AI capabiliti…☆12Sep 19, 2024Updated 2 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-t…☆30May 21, 2024Updated 2 years ago
- Cross-GPU KV Cache Marketplace☆27Nov 12, 2025Updated 10 months ago
- Discord chatbot interface to train an LLM on user message history☆27Jun 9, 2023Updated 3 years ago
- Fine-tuned transformers for protest event detection.☆11Mar 9, 2021Updated 5 years ago
- ESG Insights AI simplifies ESG data analysis with advanced AI models, ensuring compliance with GRI standards. It helps asset managers ass…☆13Oct 31, 2024Updated last year
- GPT3 Chrome Extension Starter Kit☆16Jan 16, 2023Updated 3 years ago
- ☆12May 18, 2023Updated 3 years ago