Alternatives and similar repositories for exllamav2-openai-server

Users that are interested in exllamav2-openai-server are comparing it to the libraries listed below

• zarakiquemparte / zaraki-tools
  ☆27Updated last year
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆31Updated last year
• Hellisotherpeople / llm_steer-oobabooga
  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…
  ☆43Updated last year
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆66Updated last year
• emrgnt-cmplxty / zero-shot-replication
  ☆73Updated last year
• Digitous / ModelREVOLVER
  Model REVOLVER, a human in the loop model mixing system.
  ☆33Updated last year
• EduardTalianu / EntropixLab
  entropix style sampling + GUI
  ☆26Updated 7 months ago
• brittlewis12 / autogguf
  Easily convert HuggingFace models to GGUF-format for llama.cpp
  ☆21Updated 10 months ago
• severian42 / Computational-Model-for-Symbolic-Representations
  Glyphs, acting as collaboratively defined symbols linking related concepts, add a layer of multidimensional semantic richness to user-AI …
  ☆49Updated 4 months ago
• Maximilian-Winter / llama_cpp_function_calling
  ☆31Updated last year
• nyunAI / PruneGPT
  ☆53Updated last year
• emrgnt-cmplxty / SmolTrainer
  ☆20Updated last year
• the-crypt-keeper / ggml-downloader
  Simple, Fast, Parallel Huggingface GGML model downloader written in python
  ☆24Updated last year
• Contextualist / lone-arena
  Self-hosted LLM chatbot arena, with yourself as the only judge
  ☆41Updated last year
• CoffeeVampir3 / ez-trainer
  Train Llama Loras Easily
  ☆31Updated last year
• mesolitica / transformers-openai-api
  Lightweight continuous batching OpenAI compatibility using HuggingFace Transformers include T5 and Whisper.
  ☆24Updated 3 months ago
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆33Updated last year
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated 2 years ago
• attashe / ModifiedBeamSampler
  Modified Beam Search with periodical restart
  ☆12Updated 9 months ago
• serp-ai / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆31Updated last year
• elgatopanzon / gatogpt
  Local LLM inference & management server with built-in OpenAI API
  ☆31Updated last year
• serp-ai / unsloth
  5X faster 60% less memory QLoRA finetuning
  ☆21Updated last year
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆64Updated last year
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆51Updated last year
• SLAM-group / newhope
  ☆22Updated last year
• matthewrenze / jhu-concise-cot
  The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models
  ☆22Updated 7 months ago
• danikhan632 / guidance_api
  An Extension for oobabooga/text-generation-webui
  ☆36Updated last year
• HabermannR / Fantasy-Tribe-Game
  LLM backed Fantasy Tribe Game
  ☆18Updated 7 months ago
• jukofyork / control-vectors
  Genertaes control vectors for use with llama.cpp in GGUF format.
  ☆25Updated 3 months ago
• FishiaTee / Tumera
  Yet another frontend for LLM, written using .NET and WinUI 3
  ☆10Updated 7 months ago