Alternatives and similar repositories for exllamav2-openai-server

Users that are interested in exllamav2-openai-server are comparing it to the libraries listed below

• Hellisotherpeople / llm_steer-oobabooga
  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…
  ☆42Updated last year
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆31Updated last year
• severian42 / Computational-Model-for-Symbolic-Representations
  Glyphs, acting as collaboratively defined symbols linking related concepts, add a layer of multidimensional semantic richness to user-AI …
  ☆48Updated 3 months ago
• Maximilian-Winter / llama_cpp_function_calling
  ☆30Updated last year
• CoffeeVampir3 / ez-trainer
  Train Llama Loras Easily
  ☆30Updated last year
• elgatopanzon / gatogpt
  Local LLM inference & management server with built-in OpenAI API
  ☆31Updated last year
• zarakiquemparte / zaraki-tools
  ☆27Updated last year
• Digitous / ModelREVOLVER
  Model REVOLVER, a human in the loop model mixing system.
  ☆32Updated last year
• CharlesMod / quantizeHFmodel
  Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.
  ☆38Updated last year
• mounta11n / plusplus-camall
  After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…
  ☆53Updated 9 months ago
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆66Updated last year
• SLAM-group / newhope
  ☆22Updated last year
• multiplexerai / mplx_rag
  Complex RAG backend
  ☆28Updated last year
• ragnarkar / reddit_imitator
  ☆16Updated last year
• HabermannR / Fantasy-Tribe-Game
  LLM backed Fantasy Tribe Game
  ☆18Updated 6 months ago
• thooton / muse
  Let's create synthetic textbooks together :)
  ☆75Updated last year
• ChrisHayduk / qlora-multi-gpu
  QLoRA with Enhanced Multi GPU Support
  ☆37Updated last year
• Contextualist / lone-arena
  Self-hosted LLM chatbot arena, with yourself as the only judge
  ☆41Updated last year
• SkunkworksAI / CodeFusion
  ☆15Updated last year
• ahmed-moubtahij / TokenHealer
  ☆22Updated last year
• silphendio / sliced_llama
  Simple LLM inference server
  ☆20Updated 11 months ago
• hyperfocAIs / Attend
  Attend - to what matters.
  ☆15Updated 3 months ago
• attashe / ModifiedBeamSampler
  Modified Beam Search with periodical restart
  ☆12Updated 8 months ago
• matthewrenze / jhu-concise-cot
  The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models
  ☆22Updated 6 months ago
• teknium1 / ShareGPT-Builder
  ☆113Updated 5 months ago
• the-crypt-keeper / llm-webapps
  jQuery, React and Streamlit applications written by LLMs
  ☆16Updated last year
• FarFetchd / sleepyllama
  an auto-sleeping and -waking framework around llama.cpp
  ☆12Updated 3 months ago
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆50Updated last year
• EduardTalianu / EntropixLab
  entropix style sampling + GUI
  ☆26Updated 7 months ago
• euclaise / supertrainer2000
  ☆49Updated last year