Alternatives and similar repositories for LLM-Serve

Users that are interested in LLM-Serve are comparing it to the libraries listed below

• deep-diver / PingPong
  manage histories of LLM applied applications
  ☆91Updated 2 years ago
• deep-diver / hllama
  hllama is a library which aims to provide a set of utility tools for large language models.
  ☆10Updated last year
• chainyo / picaisso
  🎨 Imagine what Picasso could have done with AI. Self-host your StableDiffusion API.
  ☆50Updated 2 years ago
• deep-diver / LLM-Pref-Mark-UI
  ☆37Updated 2 years ago
• StableFluffy / EasyLLMFeaturePorter
  1-Click is all you need.
  ☆63Updated last year
• KyujinHan / Sakura-SOLAR-DPO
  Sakura-SOLAR-DPO: Merge, SFT, and DPO
  ☆116Updated 2 years ago
• deep-diver / auto-paper-analysis
  ☆37Updated last year
• hunkim / llama-up-data
  ☆26Updated 2 years ago
• gyunggyung / LiOnConnect
  "Learning-based One-line intelligence Owner Network Connectivity Tool"
  ☆15Updated 2 years ago
• gyunggyung / OpenMLLM
  Open Source + Multilingual MLLM + Fine-tuning + Distillation + More efficient models and learning + ?
  ☆18Updated last year
• ainbr / chatgpt-weak-labeler-webui
  Weak Labeling (NER) using ChatGPT
  ☆37Updated 2 years ago
• moreh-io / motif-llm
  ☆32Updated last year
• sionic-ai / flasma
  High-performance vector search engine with no loss of accuracy through GPU and dynamic placement
  ☆31Updated 7 months ago
• hunkim / chatgpt-askup-search-plugin
  AskUp Search ChatGPT Plugin
  ☆20Updated 2 years ago
• deep-diver / janus
  generate synthetic data for LLM fine-tuning in arbitrary situations within systematic way
  ☆22Updated last year
• Zerohertz / Instruct_KR_2025_Summer_Meetup_vLLM
  🎹 Instruct.KR 2025 Summer Meetup: 오픈소스 LLM, vLLM으로 Production까지 🎹
  ☆24Updated 6 months ago
• formidable-stella / ShareGPT-translation
  ☆21Updated 2 years ago
• EleutherAI / oslo
  OSLO: Open Source for Large-scale Optimization
  ☆175Updated 2 years ago
• deep-diver / keras-sd-serving
  showing various ways to serve Keras based stable diffusion
  ☆111Updated 2 years ago
• qwopqwop200 / GPTQ-for-KoAlpaca
  ☆15Updated 2 years ago
• cloneofsimo / auto_llm_codebase_analysis
  ☆27Updated last year
• J-Seo / KoCommonGEN-V2
  KoCommonGEN v2: A Benchmark for Navigating Korean Commonsense Reasoning Challenges in Large Language Models
  ☆25Updated last year
• Marker-Inc-Korea / Korean-OpenOrca
  OpenOrca-KO dataset을 활용하여 llama2를 fine-tuning한 Korean-OpenOrca
  ☆18Updated 2 years ago
• facebookresearch / DIG-In
  This library supports evaluating disparities in generated image quality, diversity, and consistency between geographic regions.
  ☆20Updated last year
• nlp-uoregon / oregon_gpt_oss_patching
  Efficient Finetuning for OpenAI GPT-OSS
  ☆23Updated 4 months ago
• corca-ai / evaluating-gpt-4o-on-CLIcK
  Evaluate gpt-4o on CLIcK (Korean NLP Dataset)
  ☆20Updated last year
• gururise / openai_text_generation_inference_server
  Use OpenAI with HuggingChat by emulating the text_generation_inference_server
  ☆44Updated 2 years ago
• goddoe / RLYX
  A hackable, simple, and reseach-friendly GRPO Training Framework with high speed weight synchronization in a multinode environment.
  ☆36Updated 5 months ago
• sionic-ai / Llama4-Token-Editor
  ☆64Updated 6 months ago
• deep-diver / gradio-chat
  HuggingChat like UI in Gradio
  ☆70Updated 2 years ago