Alternatives and similar repositories for llmspec

Users that are interested in llmspec are comparing it to the libraries listed below

• jina-ai / rungpt
  An open-source cloud-native of large multi-modal models (LMMs) serving framework.
  ☆164Updated 2 years ago
• NEOS-AI / Neosearch
  AI-based search done right
  ☆20Updated last week
• Wannabeasmartguy / RAGENT
  Probably one of the lightest native RAG + Agent apps out there，experience the power of Agent-powered models and Agent-driven knowledge ba…
  ☆31Updated 6 months ago
• tensorchord / modelz-llm
  OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)
  ☆275Updated 2 years ago
• zozoheir / tinyllm
  Develop, evaluate and monitor LLM applications at scale
  ☆98Updated last year
• tensorchord / openmodelz
  Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
  ☆278Updated 2 years ago
• kyrolabs / langchain-service
  Opinionated Langchain setup with Qdrant vector store and Kong gateway
  ☆33Updated 2 years ago
• substratusai / vllm-docker
  ☆66Updated 8 months ago
• shivamsanju / ragswift
  🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform
  ☆38Updated last year
• nooqta / saiku
  AI Agent capable of automating various tasks using MCP
  ☆40Updated 8 months ago
• OpenBuddy / GrandSage
  ☆16Updated last year
• llmapi-io / llmapi-server
  Self-host llmapi server, make it really easy for accessing LLMs !
  ☆37Updated 2 years ago
• Unstructured-IO / unstructured.PaddleOCR
  Awesome multilingual OCR toolkits based on PaddlePaddle (practical ultra lightweight OCR system, support 80+ languages recognition, provi…
  ☆41Updated 9 months ago
• zhangzhejian / codeinterpreter-codebox
  Easy to deploy.A cloud service for python code interpreter sandbox for Code-Interpreter.
  ☆57Updated last year
• substratusai / sandboxai
  Run AI generated code in isolated sandboxes
  ☆128Updated 10 months ago
• Cerebras / DocChat
  GPT-4 Level Conversational QA Trained In a Few Hours
  ☆66Updated last year
• cnmoro / MiniVectorDB
  Lightning Fast: Faiss CPU + Onnx Quantized Multilingual Embedding Model
  ☆23Updated last year
• myscale / myscale-telemetry
  Open-source observability for your LLM application.
  ☆53Updated 11 months ago
• mystic-ai / pipeline
  Pipeline is an open source python SDK for building AI/ML workflows
  ☆138Updated last year
• yaohaizhou / awesome-agi
  🤖 A list of latest AGI-related repos, resources and courses including LLMs and AI Agents.
  ☆13Updated last year
• BlackHC / llmtracer
  Trace LLM calls (and others) and visualize them in WandB, as interactive SVG or using a streaming local webapp
  ☆14Updated 9 months ago
• muyuworks / myla
  a local implementation of OpenAI Assistants API: myla stands for MY Local Assistant
  ☆57Updated last year
• bentoml / sentence-embedding-bento
  Sentence Embedding as a Service
  ☆15Updated 5 months ago
• ialacol / text-inference-batcher
  A high performance batching router optimises max throughput for text inference workload
  ☆16Updated 2 years ago
• onepointconsulting / data-questionnaire-agent
  Data Questionnaire Agent Chatbot
  ☆69Updated 2 months ago
• intelligentnode / Intelli
  Create chatbot and AI agent workflows with unified access.
  ☆53Updated this week
• log10-io / log10
  Python client library for improving your LLM app accuracy
  ☆97Updated 10 months ago
• namuan / llm-playground
  Experiments with open source LLMs
  ☆74Updated 2 months ago
• pingcap / tidb-vector-python
  TiDB Vector SDK for Python, including code examples. Join our Discord: https://discord.gg/XzSW23Jg9p
  ☆60Updated 5 months ago
• unit-mesh / edge-infer
  EdgeInfer enables efficient edge intelligence by running small AI models, including embeddings and OnnxModels, on resource-constrained de…
  ☆49Updated last year