Alternatives and similar repositories for exllamav2-openai-server:

Users that are interested in exllamav2-openai-server are comparing it to the libraries listed below

• Hellisotherpeople / llm_steer-oobabooga
  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…
  ☆43Updated last year
• zarakiquemparte / zaraki-tools
  ☆27Updated last year
• EdwardDali / EntropixLab
  entropix style sampling + GUI
  ☆25Updated 4 months ago
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆30Updated last year
• Digitous / ModelREVOLVER
  Model REVOLVER, a human in the loop model mixing system.
  ☆33Updated last year
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆34Updated last year
• elgatopanzon / gatogpt
  Local LLM inference & management server with built-in OpenAI API
  ☆31Updated 11 months ago
• CoffeeVampir3 / ez-trainer
  Train Llama Loras Easily
  ☆31Updated last year
• brittlewis12 / autogguf
  Easily convert HuggingFace models to GGUF-format for llama.cpp
  ☆21Updated 7 months ago
• Maximilian-Winter / llama_cpp_function_calling
  ☆31Updated last year
• serp-ai / unsloth
  5X faster 60% less memory QLoRA finetuning
  ☆21Updated 9 months ago
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆65Updated last year
• ahmed-moubtahij / TokenHealer
  ☆22Updated 9 months ago
• thooton / muse
  Let's create synthetic textbooks together :)
  ☆73Updated last year
• multiplexerai / Complex-to-Simple-RAG
  ☆39Updated last year
• matthewrenze / jhu-concise-cot
  The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models
  ☆21Updated 3 months ago
• silphendio / sliced_llama
  Simple LLM inference server
  ☆20Updated 9 months ago
• teknium1 / stanford_alpaca-replit
  Modified Stanford-Alpaca Trainer for Training Replit's Code Model
  ☆40Updated last year
• LostRuins / datasetexplorer
  Easily view and modify JSON datasets for large language models
  ☆71Updated 2 weeks ago
• emrgnt-cmplxty / zero-shot-replication
  ☆73Updated last year
• Contextualist / lone-arena
  Self-hosted LLM chatbot arena, with yourself as the only judge
  ☆38Updated last year
• s4rduk4r / alpaca_lora_4bit_readme
  Just a simple HowTo for https://github.com/johnsmith0031/alpaca_lora_4bit
  ☆31Updated last year
• jukofyork / control-vectors
  Genertaes control vectors for use with llama.cpp in GGUF format.
  ☆18Updated 6 months ago
• malaysia-ai / transformers-openai-api
  Lightweight continuous batching OpenAI compatibility using HuggingFace Transformers include T5 and Whisper.
  ☆20Updated last week
• agokrani / distillKitPlus
  Easy to use, High Performant Knowledge Distillation for LLMs
  ☆54Updated this week
• the-crypt-keeper / llm-webapps
  jQuery, React and Streamlit applications written by LLMs
  ☆16Updated last year
• tolitius / towel
  "a towel is about the most massively useful thing an interstellar AI hitchhiker can have"
  ☆48Updated 5 months ago
• mounta11n / plusplus-camall
  After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…
  ☆56Updated 7 months ago