Alternatives and similar repositories for LitServe

Users that are interested in LitServe are comparing it to the libraries listed below

• SylphAI-Inc / AdalFlow
  AdalFlow: The library to build & auto-optimize LLM applications.
  ☆3,840Updated 3 weeks ago
• truefoundry / cognita
  RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry
  ☆4,264Updated 2 months ago
• predibase / lorax
  Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
  ☆3,526Updated 5 months ago
• qdrant / fastembed
  Fast, Accurate, Lightweight Python library to make State of the Art Embedding
  ☆2,462Updated this week
• AnswerDotAI / RAGatouille
  Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…
  ☆3,723Updated 5 months ago
• run-llama / llama_deploy
  Deploy your agentic worfklows to production
  ☆2,058Updated 2 months ago
• MinishLab / model2vec
  Fast State-of-the-Art Static Embeddings
  ☆1,872Updated 2 weeks ago
• run-llama / llama_cloud_services
  Knowledge Agents and Management in the Cloud
  ☆4,190Updated last week
• ucbepic / docetl
  A system for agentic LLM-powered data processing and ETL
  ☆3,010Updated last week
• cohere-ai / cohere-toolkit
  Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.
  ☆3,137Updated last week
• llamastack / llama-stack
  Composable building blocks to build Llama Apps
  ☆8,123Updated last week
• NVIDIA / nv-ingest
  NeMo Retriever extraction is a scalable, performance-oriented document content and metadata extraction microservice. NeMo Retriever extra…
  ☆2,753Updated last week
• mistralai / mistral-finetune
  ☆3,037Updated last year
• pytorch / torchchat
  Run PyTorch LLMs locally on servers, desktop and mobile
  ☆3,617Updated last month
• iterative / datachain
  ETL, Analytics, Versioning for Unstructured Data
  ☆2,691Updated last week
• PrefectHQ / ControlFlow
  🦾 Take control of your AI agents
  ☆1,380Updated 2 months ago
• michaelfeil / infinity
  Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali
  ☆2,527Updated this week
• langchain-ai / langchain-extract
  🦜⛏️ Did you say you like data?
  ☆1,173Updated 2 weeks ago
• KruxAI / ragbuilder
  A toolkit to create optimal Production-readyRetrieval Augmented Generation(RAG) setup for your data
  ☆1,508Updated 5 months ago
• roboflow / maestro
  streamline the fine-tuning process for multimodal models: PaliGemma 2, Florence-2, and Qwen2.5-VL
  ☆2,641Updated this week
• ragapp / ragapp
  The easiest way to use Agentic RAG in any enterprise
  ☆4,345Updated 9 months ago
• aurelio-labs / semantic-router
  Superfast AI decision making and intelligent processing of multi-modal data.
  ☆2,861Updated 3 weeks ago
• lm-sys / RouteLLM
  A framework for serving and evaluating LLM routers - save LLM costs without compromising quality
  ☆4,365Updated last year
• mesop-dev / mesop
  Rapidly build AI apps in Python
  ☆6,467Updated 3 weeks ago
• MLSysOps / MLE-agent
  🤖 MLE-Agent: Your intelligent companion for seamless AI engineering and research. 🔍 Integrate with arxiv and paper with code to provide…
  ☆1,396Updated 3 months ago
• argilla-io / argilla
  Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets
  ☆4,729Updated last week
• meta-pytorch / torchtune
  PyTorch native post-training library
  ☆5,564Updated this week
• gradio-app / fastrtc
  The python library for real-time communication
  ☆4,373Updated last month
• mistralai / cookbook
  ☆2,041Updated last week
• merveenoyan / smol-vision
  Recipes for shrinking, optimizing, customizing cutting edge vision models. 💜
  ☆1,769Updated this week