Provide a way to use the GPT-QLLama model as an API
☆44May 20, 2023Updated 2 years ago
Alternatives and similar repositories for GPTQ-for-LLaMa-API
Users that are interested in GPTQ-for-LLaMa-API are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 4 bits quantization of SantaCoder using GPTQ☆51Jun 6, 2023Updated 2 years ago
- ☆276May 18, 2023Updated 2 years ago
- ☆26Apr 26, 2023Updated 2 years ago
- Add voice-to-text and shortcut snippets to ChatGPT☆23Sep 12, 2024Updated last year
- ☆167Jun 1, 2023Updated 2 years ago
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Exploring what's possible with the ChatGPT Code Interpreter and how to use it effectively☆11Jul 22, 2023Updated 2 years ago
- Attempt at cog wrapper for segmind/SSD-1B☆10Dec 11, 2023Updated 2 years ago
- A no-code application that enables companies to create intelligent digital assistants.☆13Oct 9, 2023Updated 2 years ago
- Visual Studio Code extension for WizardCoder☆149Aug 1, 2023Updated 2 years ago
- Yet another LLM☆10Apr 6, 2023Updated 2 years ago
- An example of running crewai inside a container and accessing local LLMs on your computer.☆12Apr 6, 2024Updated last year
- ☆21May 27, 2023Updated 2 years ago
- Useful abstraction golang library for building AI-powered reasoning apps☆11May 31, 2023Updated 2 years ago
- Makes it simple to scrape websites with xpath structs.☆13Mar 10, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- Unofficial, reverse-engineered, community-managed OpenAPI spec for the Pinecone API☆12Apr 19, 2023Updated 2 years ago
- zPDT Stuff☆16Feb 10, 2025Updated last year
- Secrets of Tree of Thoughts for Programmers (Preview)☆17Jun 13, 2024Updated last year
- CI scripts designed to build a Pascal-compatible version of vLLM.☆12Aug 10, 2024Updated last year
- Keras implementation of Guo et al.'s Multi-View Network (2017).☆12Sep 22, 2018Updated 7 years ago
- AI Developer is an AI agent powered by GPT-4-Turbo that's using custom E2B Sandbox☆55Feb 11, 2025Updated last year
- Bookmark directories for easy directory-hopping in the terminal☆13Sep 10, 2025Updated 6 months ago
- Conversion script adapting vicuna dataset into alpaca format for use with oobabooga's trainer☆13Jun 21, 2023Updated 2 years ago
- pi + rainbowhat + touchscreen + usb sound card (mic or aux in) + open ai = audio logic anaklyzer☆12Apr 23, 2023Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- GPTQLoRA: Efficient Finetuning of Quantized LLMs with GPTQ☆101May 30, 2023Updated 2 years ago
- This released code is for our ACL2018 paper "End-Task Oriented Textual Entailment via Deep Explorations of Inter-Sentence Interactions". …☆15May 28, 2018Updated 7 years ago
- A script to circumvent the context limit of language models.☆50Mar 22, 2024Updated 2 years ago
- Python framework to generate pixel art "Choose Your Own Adventure" quests that are written and illustrated by AI☆57Sep 11, 2023Updated 2 years ago
- 🎬 Powerful, high-performance animations for PixiJS☆21Nov 19, 2025Updated 4 months ago
- Local LLM ReAct Agent with Guidance☆160May 23, 2023Updated 2 years ago
- API for backtesting and trading automation☆16Mar 13, 2026Updated last week
- Let's create synthetic textbooks together :)☆76Jan 29, 2024Updated 2 years ago
- Stock movement prediction using BERT and GPT-2 based on tweets related to the stocks☆13Jun 24, 2022Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- PTY for Node through Rust FFI☆39Mar 18, 2026Updated last week
- Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…☆145Oct 17, 2023Updated 2 years ago
- A Pythonic integration for LLMs.☆88Nov 28, 2023Updated 2 years ago
- Neural agents evolved with Neataptic to seek targets☆21Aug 27, 2017Updated 8 years ago
- Much simpler client for Stable Diffusion WebUI☆16Feb 10, 2025Updated last year
- ☆61May 15, 2024Updated last year
- BeReal Python API wrapper☆13Jul 25, 2024Updated last year