An OpenAI API compatible LLM inference server based on ExLlamaV2.
☆25Feb 9, 2024Updated 2 years ago
Alternatives and similar repositories for exllamav2-openai-server
Users that are interested in exllamav2-openai-server are comparing it to the libraries listed below
Sorting:
- Train Llama Loras Easily☆31Aug 3, 2023Updated 2 years ago
- Easily convert HuggingFace models to GGUF-format for llama.cpp☆23Jul 27, 2024Updated last year
- A collection of trading settings for the Galileo FX trading robot. These settings are designed to optimize trading strategies across vari…☆13Jan 27, 2025Updated last year
- QuIP quantization☆62Mar 17, 2024Updated last year
- Extend the Conditioning of Stable Diffusion to take Audio Embeddings Instead of Text Embeddings using Wav2Vec2-BERT model☆13Sep 25, 2024Updated last year
- A free AI text generation interface based on KoboldAI☆33Feb 27, 2024Updated 2 years ago
- A fast batching API to serve LLM models☆189Apr 26, 2024Updated last year
- An example implementation of RLHF (or, more accurately, RLAIF) built on MLX and HuggingFace.☆38Jun 21, 2024Updated last year
- A dashboard for the real-time monitoring of publicly available online COVID-19 posts across Facebook, Twitter, and Instagram by health-fo…☆13Sep 19, 2023Updated 2 years ago
- ChatGPT CSS style☆14Apr 28, 2024Updated last year
- A novel approach to detect metallic object on a moving target using wifi radios and deep learning.☆11Jan 16, 2019Updated 7 years ago
- Feature extraction from sound signals along with complete CNN model and evaluations using tensorflow, keras and, librosa for MFCC generat…☆10Jan 1, 2022Updated 4 years ago
- A PyTorch implementation of the shearlet transform.☆13Oct 9, 2025Updated 4 months ago
- EUDAMED API reference (unofficial)☆18Apr 26, 2025Updated 10 months ago
- Brute-force decoder of BIP38 encrypted private keys☆11Nov 24, 2018Updated 7 years ago
- Upgrade ERC20 -> ERC223☆12Dec 8, 2017Updated 8 years ago
- A Library for processing ERC20 payments & stablecoin payments inside smart contract.☆10Sep 12, 2021Updated 4 years ago
- run functions on app exit (receiving os signal)☆10Sep 3, 2018Updated 7 years ago
- Các thí nghiệm liên quan tới LLMs cho tiếng Việt (insprised by Physics of LLMs Series)☆11Oct 21, 2024Updated last year
- Tools for looking at the dependencies between standard library modules☆10May 24, 2020Updated 5 years ago
- Weather widget plugin for Loupedeck☆10Apr 12, 2022Updated 3 years ago
- Vast-ai public repository for open sourced tools, plugins, etc.☆16Nov 4, 2024Updated last year
- 📉📊📈 Data visualization using React Native & Chart Kit☆10Jan 4, 2023Updated 3 years ago
- Node based programming tool☆12Jan 8, 2023Updated 3 years ago
- Upscaling images in weird ways☆10Dec 14, 2024Updated last year
- An extension for oobabooga´s Text Generation WebUI☆11May 29, 2023Updated 2 years ago
- A tqdm bar progress that works with MongoDB instead of console.☆11Feb 21, 2022Updated 4 years ago
- An image processing project to detect handwritten flowcharts and generate electronic version of the flowchart. Only the the shape of the …☆12Feb 16, 2019Updated 7 years ago
- Triton‑style kernel toolkit for MLX plus a small upstream incubator: prototype, benchmark, and upstream fusions for Apple Silicon☆36Updated this week
- EXL2 quantization generalized to other models.☆10Mar 17, 2024Updated last year
- Paycom Hacky API☆13Mar 26, 2013Updated 12 years ago
- Concise Reasoning via Reinforcement Learning☆13Apr 16, 2025Updated 10 months ago
- Software made to make spriter's lives easier during the spritesheet assembly stage.☆12Oct 18, 2020Updated 5 years ago
- Trigger an LLM in your CI/CD to auto-complete your work☆11Apr 5, 2023Updated 2 years ago
- This repository contains an implementation for design patterns detection. In this task, feature engineering and ensemble learning are app…☆10Jul 30, 2022Updated 3 years ago
- Create a UI tool to use Anthropic's metaprompt but with OpenAI's GPT-4o, unlocking the master prompt to prompt them all.☆13Nov 11, 2024Updated last year
- A LLM Agent capable of fixing bug by himself from a Javascript Error☆12Sep 6, 2023Updated 2 years ago
- Extension for stable diffusion webui to add advance prompt tuning☆10Nov 13, 2022Updated 3 years ago
- Talk to your computer. You know you want to.☆11Mar 13, 2016Updated 9 years ago