Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.
☆91Jun 19, 2023Updated 2 years ago
Alternatives and similar repositories for AutoGPTQ-API
Users that are interested in AutoGPTQ-API are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Visual Studio Code extension for WizardCoder☆148Aug 1, 2023Updated 2 years ago
- ☆13Oct 22, 2023Updated 2 years ago
- A small standalone flask python server for llama.cpp that acts like a KoboldAI api.☆14May 20, 2023Updated 2 years ago
- A KoboldAI-like memory extension for oobabooga's text-generation-webui☆108Oct 29, 2024Updated last year
- ☆16Sep 22, 2024Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Creates an Langchain Agent which uses the WebUI's API and Wikipedia to work☆73Sep 12, 2023Updated 2 years ago
- Oobabooga "Hello World" API example for node.js with Express☆13Jul 2, 2023Updated 2 years ago
- ☆17Feb 15, 2023Updated 3 years ago
- Docker images and configuration to run text-generation-webui with GPU or CPU support☆32Mar 19, 2024Updated 2 years ago
- Text WebUI extension to add clever Notebooks to Chat mode☆147Aug 7, 2025Updated 8 months ago
- A web-app to explore topics using LLM (less typing and more clicks)☆67Mar 15, 2026Updated last month
- Python examples using the bigcode/tiny_starcoder_py 159M model to generate code☆45May 31, 2023Updated 2 years ago
- Personal voice assistant, with voice interruption and Twilio support☆18Feb 24, 2025Updated last year
- An autonomous AI agent extension for Oobabooga's web ui☆171Sep 7, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- 基于RWKV模型的角色扮演，实际上是个改的妈都不认识的 RWKV_Role_Playing☆17Aug 17, 2023Updated 2 years ago
- AI-powered task management system template w/ free storage use☆41Apr 17, 2023Updated 3 years ago
- Cross-GPU KV Cache Marketplace☆22Nov 12, 2025Updated 5 months ago
- An Autonomous LLM Agent that runs on Wizcoder-15B☆336Oct 21, 2024Updated last year
- ☆12Apr 4, 2024Updated 2 years ago
- Proteus is an experimental platform that combines the power of Large Language Models with the Genesis physics engine☆26Dec 20, 2024Updated last year
- Android app that helps you copy text from images.☆13May 20, 2022Updated 3 years ago
- CodeUp: A Multilingual Code Generation Llama-X Model with Parameter-Efficient Instruction-Tuning☆127Dec 25, 2024Updated last year
- Open-source coding assistant for Visual Studio Code. Connect to LLMs from OpenAI or Google.☆18Aug 14, 2023Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Friendly Terminal Assistant for Developers☆17Mar 23, 2024Updated 2 years ago
- A Python-based chatbot project built on the autogen and tinygrad foundation, utilizing advanced agents for dynamic conversations and func…☆26Oct 9, 2024Updated last year
- ☆15Sep 23, 2024Updated last year
- RUN LLAMA-3 70B llm with NVIDIA endpoints☆14Apr 20, 2024Updated 2 years ago
- ☆74Sep 5, 2023Updated 2 years ago
- run ollama & gguf easily with a single command☆52May 15, 2024Updated last year
- ☆22Jun 13, 2024Updated last year
- Groquments is a simple demonstration project showcasing how easily PocketGroq can help developers integrate Groq's powerful AI capabiliti…☆12Sep 19, 2024Updated last year
- ☆11Mar 6, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Guaranty the output of an LLM to follow a json schema.☆25Dec 6, 2023Updated 2 years ago
- PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-t…☆30May 21, 2024Updated last year
- ESG Insights AI simplifies ESG data analysis with advanced AI models, ensuring compliance with GRI standards. It helps asset managers ass…☆13Oct 31, 2024Updated last year
- Repo to showcase solution examples and learning content curated by the advanced analytics experts within Microsoft Finance☆17Sep 2, 2022Updated 3 years ago
- Smart reproducible analytical pipeline inspection☆21Feb 13, 2026Updated 2 months ago
- ☆41Nov 30, 2023Updated 2 years ago
- Datasette enrichment for analyzing row data using OpenAI's GPT models☆22May 15, 2024Updated last year