An OpenAI API compatible LLM inference server based on ExLlamaV2.
☆25Feb 9, 2024Updated 2 years ago
Alternatives and similar repositories for exllamav2-openai-server
Users that are interested in exllamav2-openai-server are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Train Llama Loras Easily☆31Aug 3, 2023Updated 2 years ago
- A fast batching API to serve LLM models☆189Apr 26, 2024Updated 2 years ago
- Extension for stable diffusion webui to add advance prompt tuning☆10Nov 13, 2022Updated 3 years ago
- ☆12Sep 22, 2024Updated last year
- Atomatic Drone Control is an airbornedrone obstacle avoiding and navagation program☆12Sep 24, 2015Updated 10 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- ☆34Dec 15, 2025Updated 6 months ago
- Simple node proxy for llama-server that enables MCP use☆19May 10, 2025Updated last year
- Easily convert HuggingFace models to GGUF-format for llama.cpp☆23Jul 27, 2024Updated last year
- A native SwiftUI Mac/iPhone/iPad app for chatting with LLMs☆35Aug 19, 2023Updated 2 years ago
- A free AI text generation interface based on KoboldAI☆32Feb 27, 2024Updated 2 years ago
- Fill up the `model_list` field in your LiteLLM proxy configuration file☆10Sep 7, 2024Updated last year
- QuIP quantization☆66Mar 17, 2024Updated 2 years ago
- Official ArchiveBox MITM proxy: saves URLs of all requests passing through to an ArchiveBox server for archival.☆33Jul 12, 2024Updated last year
- Multi-Domain Expert Learning☆67Jan 23, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- An original elixir simplex noise implementation. Elixir translations of a couple of Java reference implementations are also included.☆11Dec 7, 2017Updated 8 years ago
- Eh, simple and works.☆27Dec 9, 2023Updated 2 years ago
- Medusa combo files, Hashcat rules and dictionaries, JRT rules☆14Oct 20, 2022Updated 3 years ago
- ☆28Aug 30, 2023Updated 2 years ago
- Extend the Conditioning of Stable Diffusion to take Audio Embeddings Instead of Text Embeddings using Wav2Vec2-BERT model☆13Sep 25, 2024Updated last year
- Blurhash in Erlang☆11Mar 5, 2023Updated 3 years ago
- Curated list of awesome plugins for ChatGPT☆15Mar 23, 2023Updated 3 years ago
- LLM Skirmish☆46Feb 3, 2026Updated 5 months ago
- A hybrid LaTeX code + rich-text editor. It seamlessly syncs a rich-text What You See Is What You Get (WYSIWYG) view with raw LaTeX source…☆37Jun 27, 2026Updated last week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- This is my personal nextJS tool for sandboxing/testing GPT 3 prompts.☆11Jan 29, 2026Updated 5 months ago
- The official API server for Exllama. OAI compatible, lightweight, and fast.☆1,261Jun 27, 2026Updated last week
- ☆10Aug 26, 2021Updated 4 years ago
- mlx implementations of various transformers, speedups, training☆33Dec 14, 2023Updated 2 years ago
- A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.☆103Jun 29, 2025Updated last year
- Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…☆46Mar 21, 2024Updated 2 years ago
- A data visualisation of a 100 responses when asking local LLMs to imagine a random person.☆24Nov 4, 2024Updated last year
- A modified Ziggurat Algorithm for efficiently generating exponentially- and normally-distributed PseudoRandom Numbers (PRNs).☆13May 21, 2025Updated last year
- ☆11Jul 23, 2023Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Conversion script adapting vicuna dataset into alpaca format for use with oobabooga's trainer☆13Jun 21, 2023Updated 3 years ago
- ChatGPT solutions for the MLE interview☆14Dec 9, 2022Updated 3 years ago
- Raw image editor with built-in film emulation.☆30Jun 27, 2026Updated last week
- Finding explainable models to predict Formula 1 Qualifying Results☆13Apr 7, 2022Updated 4 years ago
- A library for web scraping, inspired by MetaInspector☆11May 29, 2017Updated 9 years ago
- A set of methods for finding an appropriate number of topics in a text collection☆15Apr 13, 2026Updated 2 months ago
- miaoshouai-assistant for webui-forge☆15Aug 15, 2024Updated last year