bjj / exllamav2-openai-serverLinks
An OpenAI API compatible LLM inference server based on ExLlamaV2.
☆25Updated last year
Alternatives and similar repositories for exllamav2-openai-server
Users that are interested in exllamav2-openai-server are comparing it to the libraries listed below
Sorting:
- Let's create synthetic textbooks together :)☆75Updated last year
- GPT-2 small trained on phi-like data☆67Updated last year
- Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…☆43Updated last year
- An unsupervised model merging algorithm for Transformers-based language models.☆108Updated last year
- Experimental sampler to make LLMs more creative☆31Updated 2 years ago
- Model REVOLVER, a human in the loop model mixing system.☆33Updated 2 years ago
- ☆27Updated 2 years ago
- Low-Rank adapter extraction for fine-tuned transformers models☆180Updated last year
- ☆74Updated 2 years ago
- Easily view and modify JSON datasets for large language models☆86Updated 7 months ago
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆124Updated 2 years ago
- Full finetuning of large language models without large memory requirements☆94Updated 3 months ago
- LLM-Training-API: Including Embeddings & ReRankers, mergekit, LaserRMT☆27Updated last year
- Experimental LLM Inference UX to aid in creative writing☆127Updated last year
- ☆50Updated last year
- ☆119Updated last year
- ☆51Updated last year
- jQuery, React and Streamlit applications written by LLMs☆16Updated 2 years ago
- Deploy your GGML models to HuggingFace Spaces with Docker and gradio☆38Updated 2 years ago
- Train Llama Loras Easily☆31Updated 2 years ago
- run ollama & gguf easily with a single command☆52Updated last year
- After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…☆53Updated last year
- A guidance compatibility layer for llama-cpp-python☆36Updated 2 years ago
- entropix style sampling + GUI☆27Updated last year
- A repository to store helpful information and emerging insights in regard to LLMs☆21Updated 2 years ago
- SLOP Detector and analyzer based on dictionary for shareGPT JSON and text☆79Updated last month
- ☆137Updated last year
- ☆16Updated 2 years ago
- ☆23Updated last year
- 5X faster 60% less memory QLoRA finetuning☆21Updated last year