Alternatives and similar repositories for exllamav2-openai-server

Users that are interested in exllamav2-openai-server are comparing it to the libraries listed below

• Hellisotherpeople / llm_steer-oobabooga
  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…
  ☆43Updated last year
• thooton / muse
  Let's create synthetic textbooks together :)
  ☆75Updated last year
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆31Updated last year
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆66Updated last year
• zarakiquemparte / zaraki-tools
  ☆27Updated last year
• desik1998 / MathWithLLMs
  ☆49Updated last year
• matthewrenze / jhu-concise-cot
  The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models
  ☆22Updated 7 months ago
• EduardTalianu / EntropixLab
  entropix style sampling + GUI
  ☆26Updated 8 months ago
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆35Updated last year
• reka-ai / rekaquant
  ☆49Updated this week
• severian42 / Computational-Model-for-Symbolic-Representations
  Glyphs, acting as collaboratively defined symbols linking related concepts, add a layer of multidimensional semantic richness to user-AI …
  ☆49Updated 5 months ago
• silphendio / sliced_llama
  Simple LLM inference server
  ☆20Updated last year
• tolitius / towel
  "a towel is about the most massively useful thing an interstellar AI hitchhiker can have"
  ☆48Updated 9 months ago
• serp-ai / unsloth
  5X faster 60% less memory QLoRA finetuning
  ☆21Updated last year
• serp-ai / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆31Updated last year
• PuchToTalk / DOOM-MistralAI
  Mistral7B playing DOOM
  ☆28Updated last year
• l4b4r4b4b4 / AIDocks
  LLM-Training-API: Including Embeddings & ReRankers, mergekit, LaserRMT
  ☆27Updated last year
• cognitivecomputations / kraken
  ☆66Updated last year
• catena-labs / moa-llm
  A Python library to orchestrate LLMs in a neural network-inspired structure
  ☆49Updated 9 months ago
• shivamsanju / ragswift
  🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform
  ☆38Updated last year
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆52Updated last year
• emrgnt-cmplxty / zero-shot-replication
  ☆74Updated last year
• teknium1 / ShareGPT-Builder
  ☆115Updated 6 months ago
• attashe / ModifiedBeamSampler
  Modified Beam Search with periodical restart
  ☆12Updated 10 months ago
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers models
  ☆173Updated last year
• LostRuins / datasetexplorer
  Easily view and modify JSON datasets for large language models
  ☆77Updated 2 months ago
• ahmed-moubtahij / TokenHealer
  ☆22Updated last year
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆105Updated last year
• multimodalart / grog
  Gradio UI for a Cog API
  ☆69Updated last year
• huseinzol05 / transformers-continuous-batching
  Lightweight continuous batching OpenAI compatibility using HuggingFace Transformers include T5 and Whisper.
  ☆26Updated 4 months ago