Alternatives and similar repositories for exllamav2-openai-server:

Users that are interested in exllamav2-openai-server are comparing it to the libraries listed below

• zarakiquemparte / zaraki-tools
  ☆27Updated last year
• Hellisotherpeople / llm_steer-oobabooga
  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…
  ☆42Updated 9 months ago
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆30Updated last year
• agokrani / distillKitPlus
  Easy to use, High Performant Knowledge Distillation for LLMs
  ☆38Updated last week
• EdwardDali / EntropixLab
  entropix style sampling + GUI
  ☆25Updated 2 months ago
• Digitous / ModelREVOLVER
  Model REVOLVER, a human in the loop model mixing system.
  ☆33Updated last year
• OpenAccess-AI-Collective / ggml-webui
  Deploy your GGML models to HuggingFace Spaces with Docker and gradio
  ☆35Updated last year
• emrgnt-cmplxty / SmolTrainer
  ☆20Updated last year
• teknium1 / ShareGPT-Builder
  ☆108Updated last month
• matthewrenze / jhu-concise-cot
  The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models
  ☆21Updated last month
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆34Updated last year
• SLAM-group / newhope
  ☆22Updated last year
• charmandercha / ArchiDoc
  ☆16Updated last month
• enjalot / fineweb-modal
  Using modal.com to process FineWeb-edu data
  ☆19Updated last month
• serp-ai / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆31Updated 7 months ago
• partycia / multilingual-embedding-models
  ☆20Updated 11 months ago
• serp-ai / unsloth
  5X faster 60% less memory QLoRA finetuning
  ☆21Updated 7 months ago
• thooton / muse
  Let's create synthetic textbooks together :)
  ☆73Updated 11 months ago
• ChrisHayduk / qlora-multi-gpu
  QLoRA with Enhanced Multi GPU Support
  ☆36Updated last year
• attashe / ModifiedBeamSampler
  Modified Beam Search with periodical restart
  ☆12Updated 4 months ago
• argilla-io / distilabel-spin-dibt
  Repository containing the SPIN experiments on the DIBT 10k ranked prompts
  ☆24Updated 10 months ago
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆65Updated 11 months ago
• ahmed-moubtahij / TokenHealer
  ☆21Updated 7 months ago
• Contextualist / lone-arena
  Self-hosted LLM chatbot arena, with yourself as the only judge
  ☆36Updated 11 months ago
• silphendio / sliced_llama
  Simple LLM inference server
  ☆19Updated 7 months ago
• Dhaladom / TALIS
  Simple and fast server for GPTQ-quantized LLaMA inference
  ☆24Updated last year
• multiplexerai / Complex-to-Simple-RAG
  ☆39Updated 11 months ago
• CoffeeVampir3 / ez-trainer
  Train Llama Loras Easily
  ☆30Updated last year
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆93Updated last year