Alternatives and similar repositories for llmspec

Users that are interested in llmspec are comparing it to the libraries listed below

• NEOS-AI / Neosearch
  AI-based search done right
  ☆20Updated last month
• jina-ai / rungpt
  An open-source cloud-native of large multi-modal models (LMMs) serving framework.
  ☆164Updated 2 years ago
• tensorchord / modelz-llm
  OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)
  ☆275Updated 2 years ago
• tensorchord / openmodelz
  Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
  ☆277Updated 2 years ago
• pingcap / tidb-vector-python
  TiDB Vector SDK for Python, including code examples. Join our Discord: https://discord.gg/XzSW23Jg9p
  ☆60Updated 4 months ago
• muyuworks / myla
  a local implementation of OpenAI Assistants API: myla stands for MY Local Assistant
  ☆57Updated last year
• tensorchord / ai-infra-statistics
  This repository contains statistics about the AI Infrastructure products.
  ☆17Updated 9 months ago
• cnmoro / MiniVectorDB
  Lightning Fast: Faiss CPU + Onnx Quantized Multilingual Embedding Model
  ☆23Updated last year
• Wannabeasmartguy / RAGENT
  Probably one of the lightest native RAG + Agent apps out there，experience the power of Agent-powered models and Agent-driven knowledge ba…
  ☆28Updated 6 months ago
• BlackHC / llmtracer
  Trace LLM calls (and others) and visualize them in WandB, as interactive SVG or using a streaming local webapp
  ☆14Updated 9 months ago
• myscale / myscale-telemetry
  Open-source observability for your LLM application.
  ☆53Updated 10 months ago
• substratusai / vllm-docker
  ☆64Updated 8 months ago
• kyegomez / MLXTransformer
  Simple Implementation of a Transformer in the new framework MLX by Apple
  ☆19Updated last year
• zozoheir / tinyllm
  Develop, evaluate and monitor LLM applications at scale
  ☆98Updated last year
• bentoml / BentoOCR
  Turn any OCR models into online inference API endpoint 🚀 🌖
  ☆57Updated last month
• mystic-ai / pipeline
  Pipeline is an open source python SDK for building AI/ML workflows
  ☆138Updated last year
• Unstructured-IO / unstructured.PaddleOCR
  Awesome multilingual OCR toolkits based on PaddlePaddle (practical ultra lightweight OCR system, support 80+ languages recognition, provi…
  ☆40Updated 8 months ago
• OpenBuddy / GrandSage
  ☆16Updated last year
• nooqta / saiku
  AI Agent capable of automating various tasks using MCP
  ☆40Updated 7 months ago
• Swarno-Coder / PersonalGPT
  Your own GPT-powered Personal Assistant to whom you can ORDER or INSTRUCT to do some task or search for something using your VOICE comman…
  ☆20Updated 2 years ago
• llmapi-io / llmapi-server
  Self-host llmapi server, make it really easy for accessing LLMs !
  ☆37Updated 2 years ago
• intelligentnode / Intelli
  Create chatbot and AI agent workflows with unified access.
  ☆53Updated 2 weeks ago
• TaskingAI / TaskingAI-Python-Client
  TaskingAI Python Client
  ☆21Updated 10 months ago
• zhangzhejian / codeinterpreter-codebox
  Easy to deploy.A cloud service for python code interpreter sandbox for Code-Interpreter.
  ☆56Updated last year
• mehdihosseinimoghadam / open-sourced-nootbookLM
  Open Sourced NoteBookLM
  ☆59Updated last year
• inferless / smaug-72b
  Smaug-72B topped the Hugging Face LLM leaderboard and it’s the first model with an average score of 80, making it the world’s best open-s…
  ☆17Updated 7 months ago
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆79Updated last year
• OpenCSGs / llm-inference
  llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deploy…
  ☆89Updated last year
• kyrolabs / langchain-service
  Opinionated Langchain setup with Qdrant vector store and Kong gateway
  ☆33Updated 2 years ago
• fixie-ai / thefastest.ai
  Website with current metrics on the fastest AI models.
  ☆42Updated last year