Alternatives and similar repositories for exllamav2-openai-server

Users that are interested in exllamav2-openai-server are comparing it to the libraries listed below

• Hellisotherpeople / llm_steer-oobabooga
  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…
  ☆42Updated last year
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆67Updated last year
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆31Updated 2 years ago
• thooton / muse
  Let's create synthetic textbooks together :)
  ☆75Updated last year
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers models
  ☆177Updated last year
• nyunAI / PruneGPT
  ☆51Updated last year
• zarakiquemparte / zaraki-tools
  ☆26Updated 2 years ago
• teknium1 / ShareGPT-Builder
  ☆116Updated 10 months ago
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆106Updated last year
• emrgnt-cmplxty / zero-shot-replication
  ☆73Updated 2 years ago
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆52Updated last year
• desik1998 / MathWithLLMs
  ☆49Updated last year
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆36Updated 2 years ago
• mounta11n / plusplus-camall
  After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…
  ☆53Updated last year
• Cerebras / DocChat
  GPT-4 Level Conversational QA Trained In a Few Hours
  ☆65Updated last year
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆118Updated last year
• lachlansneff / sparsellama
  ☆40Updated 2 years ago
• ahmed-moubtahij / TokenHealer
  ☆23Updated last year
• LostRuins / datasetexplorer
  Easily view and modify JSON datasets for large language models
  ☆83Updated 5 months ago
• severian42 / Computational-Model-for-Symbolic-Representations
  Glyphs, acting as collaboratively defined symbols linking related concepts, add a layer of multidimensional semantic richness to user-AI …
  ☆52Updated 8 months ago
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆93Updated last month
• QuixiAI / kraken
  ☆67Updated last year
• serp-ai / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆31Updated last year
• EduardTalianu / EntropixLab
  entropix style sampling + GUI
  ☆27Updated 11 months ago
• huseinzol05 / transformers-continuous-batching
  Lightweight continuous batching OpenAI compatibility using HuggingFace Transformers include T5 and Whisper.
  ☆29Updated 7 months ago
• CoffeeVampir3 / ez-trainer
  Train Llama Loras Easily
  ☆30Updated 2 years ago
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆63Updated 2 years ago
• chimezie / mlx-tuning-fork
  Very basic framework for composable parameterized large language model (Q)LoRA / (Q)Dora fine-tuning using mlx, mlx_lm, and OgbujiPT.
  ☆42Updated 4 months ago
• jukofyork / transplant-vocab
  Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.
  ☆42Updated 2 weeks ago
• adrienbrault / ollama-nous-hermes2pro
  Ollama models of NousResearch/Hermes-2-Pro-Mistral-7B-GGUF
  ☆31Updated last year