Provide a way to use the GPT-QLLama model as an API
☆44May 20, 2023Updated 2 years ago
Alternatives and similar repositories for GPTQ-for-LLaMa-API
Users that are interested in GPTQ-for-LLaMa-API are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Makes llama.cpp easy to use.☆12May 14, 2025Updated 11 months ago
- Add voice-to-text and shortcut snippets to ChatGPT☆23Sep 12, 2024Updated last year
- Open source code combining implementations of Upside Down Reinforcement Learning and Reward Conditioned Policies☆20Mar 10, 2021Updated 5 years ago
- Plugin Allows loading of local llms into Auto-GPT☆12Apr 21, 2023Updated 3 years ago
- An open source MCP proxy.☆17Jan 3, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- A no-code application that enables companies to create intelligent digital assistants.☆13Oct 9, 2023Updated 2 years ago
- Lossless normalization of uppercase characters☆11Jul 3, 2023Updated 2 years ago
- Streamlit apps on Cloud Run with Identity-Aware Proxy (IAP).☆10Mar 5, 2022Updated 4 years ago
- Visual Studio Code extension for WizardCoder☆148Aug 1, 2023Updated 2 years ago
- Local LLM Agent with Guidance☆13May 26, 2023Updated 2 years ago
- A shell script for building and releasing go programs on Github☆14Feb 22, 2017Updated 9 years ago
- ☆13Jul 15, 2023Updated 2 years ago
- Yet another LLM☆10Apr 6, 2023Updated 3 years ago
- BabyAGI to run with locally hosted models using the API from https://github.com/oobabooga/text-generation-webui☆86May 6, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- An example of running crewai inside a container and accessing local LLMs on your computer.☆12Apr 6, 2024Updated 2 years ago
- ☆21May 27, 2023Updated 2 years ago
- MCP server enabling Image Generation for LLMs, built in Python and integrated with Together AI.☆18Mar 11, 2025Updated last year
- A self-hosted Telgram bot that integrates GPT with custom external tools☆16Oct 21, 2024Updated last year
- ☆25Feb 17, 2026Updated 2 months ago
- zPDT Stuff☆16Feb 10, 2025Updated last year
- CI scripts designed to build a Pascal-compatible version of vLLM.☆12Aug 10, 2024Updated last year
- Attend - to what matters.☆17Feb 22, 2025Updated last year
- ☆13Jan 3, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆10Sep 14, 2022Updated 3 years ago
- Bookmark directories for easy directory-hopping in the terminal☆13Sep 10, 2025Updated 7 months ago
- ☆14Jun 20, 2023Updated 2 years ago
- pi + rainbowhat + touchscreen + usb sound card (mic or aux in) + open ai = audio logic anaklyzer☆12Apr 23, 2023Updated 3 years ago
- Singapore Condo Rental Prices - From Data Acquisition to Prediction☆14Feb 13, 2021Updated 5 years ago
- Inefficient markets allow investors to consistently outperform the market. In order to demonstrate that inefficiencies exist in sports be…☆10Jun 12, 2018Updated 7 years ago
- GPTQLoRA: Efficient Finetuning of Quantized LLMs with GPTQ☆101May 30, 2023Updated 2 years ago
- A script to circumvent the context limit of language models.☆50Mar 22, 2024Updated 2 years ago
- Python framework to generate pixel art "Choose Your Own Adventure" quests that are written and illustrated by AI☆57Sep 11, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆16May 8, 2023Updated 2 years ago
- A command line tool for running GPT commands. This tool supports prompt-batching and prompt-chaining.☆17May 22, 2023Updated 2 years ago
- ChatGPT learns automatically.☆25May 5, 2023Updated 3 years ago
- Easily create and pick values from Random Distributions and Markov Chains.☆10Apr 17, 2026Updated 2 weeks ago
- Github repo of the CHARLIE AI interaction project☆14Aug 2, 2023Updated 2 years ago
- Local LLM ReAct Agent with Guidance☆158May 23, 2023Updated 2 years ago
- Let's create synthetic textbooks together :)☆76Jan 29, 2024Updated 2 years ago