Alternatives and similar repositories for llmapibenchmark

Users that are interested in llmapibenchmark are comparing it to the libraries listed below

• gpustack / llama-box
  LM inference server implementation based on *.cpp.
  ☆226Updated this week
• soulteary / amazing-openai-api
  Convert different model APIs into the OpenAI API format out of the box.
  ☆153Updated last year
• gpustack / vox-box
  A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.
  ☆124Updated 2 weeks ago
• horus-ai-labs / DistillFlow
  Library for model distillation
  ☆144Updated 4 months ago
• chuanruihu / Level-Navi-Agent-Search
  The Level-Navi Agent, a framework that requires no training and utilizes large language models for deep query understanding and precise s…
  ☆79Updated 5 months ago
• limcheekin / open-text-embeddings
  Open Source Text Embedding Models with OpenAI Compatible API
  ☆153Updated 11 months ago
• ninehills / llm-inference-benchmark
  LLM Inference benchmark
  ☆421Updated 11 months ago
• shell-nlp / gpt_server
  gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR和TTS的开源框架。
  ☆194Updated this week
• wade1010 / graphrag-ui
  The latest graphrag interface is used, using the local ollama to provide the LLM interface.Support for using the pip installation
  ☆152Updated 8 months ago
• daodao97 / gptpdf-ui
  Using GPT to parse PDF
  ☆98Updated 9 months ago
• lwyBZss8924d / DeepSearchAgents
  Awesome Code Action - DeepWebSearch AgentKit App. Build with 🤗 Hugging Face smolagents framework
  ☆72Updated last week
• hustyichi / dify-eval
  基于 Dify + Langfuse 的自动化评估服务
  ☆68Updated 3 weeks ago
• dataelement / bisheng-unstructured
  bisheng-unstructured library
  ☆51Updated last month
• etrobot / nextArtifacts
  A Next.js version of Claude Aritfacts , inspired by llamacoder
  ☆23Updated 9 months ago
• KylinMountain / markify
  Convert files into markdown to help RAG or LLM understand, based on markitdown and MinerU, which could provide high quality pdf parser.
  ☆108Updated 2 months ago
• zhanghx0905 / qwen-tools-openai-server
  An OpenAI API-compatible middleware for Qwen OpenAI API, implementing (stream) tool calling functionality
  ☆9Updated 10 months ago
• and270 / thinking_effort_processor
  ☆90Updated 3 months ago
• wey-gu / grpo-graph-extraction
  Qwen GRPO Graph Extraction RL Finetune
  ☆49Updated 2 months ago
• shibing624 / agentica
  Agentica: Effortlessly Build Intelligent, Reflective, and Collaborative Multimodal AI Agents! 构建智能的多模态AI Agent。
  ☆175Updated this week
• JiangYain / Dify_Pipeline_OpenwebUI
  通过该项目将Dify通过Pipeline接入OpenwebUI，可以兼并OpenwebUI的前端优势和相应生态以及Dify强大的模型可拓展性和Workflow的效益。
  ☆32Updated 6 months ago
• Azure99 / BlossomData
  A fluent, scalable, and easy-to-use LLM data processing framework.
  ☆21Updated 2 weeks ago
• AaronFeng753 / Better-Qwen3
  Auto Thinking Mode switch for Qwen3 in Open webui
  ☆65Updated last month
• hargup / reader
  Clone of https://r.jina.ai which is deployable locally
  ☆44Updated 9 months ago
• OpenCSGs / AutoHub
  AutoHub: A Personal Browser Automation Assistant
  ☆22Updated last week
• chu-tianxiang / vllm-gptq
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆131Updated last year
• ubergarm / r1-ktransformers-guide
  run DeepSeek-R1 GGUFs on KTransformers
  ☆236Updated 3 months ago
• chisaki-takahashi / dify-plugin-mem0ai
  与 https://github.com/tonori/mem0ai-api 配合使用的非官方的 mem0ai provider.
  ☆48Updated 11 months ago
• 2404589803 / hf-daily-paper-newsletter-chinese
  🔥Your Daily Dose of AI Research from Hugging Face 🔥 Stay updated with the latest AI breakthroughs! This bot automatically collects and…
  ☆52Updated this week
• gpustack / gpustack-ui
  ☆39Updated this week
• OpenCSGs / llm-inference
  llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deploy…
  ☆82Updated last year