Alternatives and similar repositories for exllamav2-openai-server

Users that are interested in exllamav2-openai-server are comparing it to the libraries listed below

• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆68Updated last year
• thooton / muse
  Let's create synthetic textbooks together :)
  ☆76Updated 2 years ago
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers models
  ☆180Updated last year
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆31Updated 2 years ago
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆52Updated last year
• CoffeeVampir3 / ez-trainer
  Train Llama Loras Easily
  ☆31Updated 2 years ago
• Digitous / ModelREVOLVER
  Model REVOLVER, a human in the loop model mixing system.
  ☆33Updated 2 years ago
• desik1998 / MathWithLLMs
  ☆50Updated last year
• emrgnt-cmplxty / zero-shot-replication
  ☆74Updated 2 years ago
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆108Updated last year
• teknium1 / ShareGPT-Builder
  ☆119Updated last year
• zarakiquemparte / zaraki-tools
  ☆27Updated 2 years ago
• tolitius / towel
  "a towel is about the most massively useful thing an interstellar AI hitchhiker can have"
  ☆48Updated last year
• Hellisotherpeople / llm_steer-oobabooga
  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…
  ☆44Updated last year
• nyunAI / PruneGPT
  ☆51Updated last year
• the-crypt-keeper / LLooM
  Experimental LLM Inference UX to aid in creative writing
  ☆127Updated last year
• emrgnt-cmplxty / SmolTrainer
  ☆21Updated 2 years ago
• ahmed-moubtahij / TokenHealer
  ☆23Updated last year
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆124Updated 2 years ago
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆94Updated 4 months ago
• SicariusSicariiStuff / SLOP_Detector
  SLOP Detector and analyzer based on dictionary for shareGPT JSON and text
  ☆80Updated last month
• Dhaladom / TALIS
  Simple and fast server for GPTQ-quantized LLaMA inference
  ☆24Updated 2 years ago
• l4b4r4b4b4 / AIDocks
  LLM-Training-API: Including Embeddings & ReRankers, mergekit, LaserRMT
  ☆27Updated last year
• EduardTalianu / EntropixLab
  entropix style sampling + GUI
  ☆27Updated last year
• jukofyork / transplant-vocab
  Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.
  ☆48Updated 3 months ago
• QuixiAI / kraken
  ☆68Updated last year
• LostRuins / datasetexplorer
  Easily view and modify JSON datasets for large language models
  ☆86Updated 8 months ago
• michaelfeil / embed
  A stable, fast and easy-to-use inference library with a focus on a sync-to-async API
  ☆47Updated last year
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆36Updated 2 years ago
• spyglass-search / talos
  Easily create LLM automation/agent workflows
  ☆60Updated last year