Alternatives and similar repositories for LitServe:

Users that are interested in LitServe are comparing it to the libraries listed below

• AnswerDotAI / RAGatouille
  Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…
  ☆3,328Updated last month
• chonkie-ai / chonkie
  🦛 CHONK your texts with Chonkie ✨ - The no-nonsense RAG chunking library
  ☆2,818Updated this week
• qdrant / fastembed
  Fast, Accurate, Lightweight Python library to make State of the Art Embedding
  ☆1,882Updated this week
• predibase / lorax
  Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
  ☆2,802Updated 2 weeks ago
• mistralai / mistral-finetune
  ☆2,889Updated 6 months ago
• pytorch / torchchat
  Run PyTorch LLMs locally on servers, desktop and mobile
  ☆3,530Updated this week
• truefoundry / cognita
  RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry
  ☆3,961Updated last month
• lm-sys / RouteLLM
  A framework for serving and evaluating LLM routers - save LLM costs without compromising quality
  ☆3,729Updated 7 months ago
• mistralai / cookbook
  ☆1,567Updated last week
• pytorch / torchtune
  PyTorch native post-training library
  ☆5,014Updated this week
• SylphAI-Inc / AdalFlow
  AdalFlow: The library to build & auto-optimize LLM applications.
  ☆2,884Updated last week
• ucbepic / docetl
  A system for agentic LLM-powered data processing and ETL
  ☆1,718Updated this week
• getzep / graphiti
  Build and query dynamic, temporally-aware Knowledge Graphs
  ☆2,478Updated this week
• MinishLab / model2vec
  Fast State-of-the-Art Static Embeddings
  ☆1,109Updated 3 weeks ago
• run-llama / llama_cloud_services
  Knowledge Agents and Management in the Cloud
  ☆3,791Updated this week
• merveenoyan / smol-vision
  Recipes for shrinking, optimizing, customizing cutting edge vision models. 💜
  ☆1,316Updated last week
• Lightning-AI / lightning-thunder
  Make PyTorch models up to 40% faster! Thunder is a source to source compiler for PyTorch. It enables using different hardware executors a…
  ☆1,310Updated this week
• pytorch / ao
  PyTorch native quantization and sparsity for training and inference
  ☆1,913Updated this week
• instructor-ai / instructor
  structured outputs for llms
  ☆9,860Updated this week
• pydantic / pydantic-ai
  Agent Framework / shim to use Pydantic with LLMs
  ☆7,308Updated this week
• freddyaboulton / fastrtc
  The python library for real-time communication
  ☆3,148Updated this week
• aurelio-labs / semantic-router
  Superfast AI decision making and intelligent processing of multi-modal data.
  ☆2,473Updated last week
• MadcowD / ell
  A language model programming library.
  ☆5,689Updated 3 weeks ago
• EricLBuehler / mistral.rs
  Blazingly fast LLM inference.
  ☆5,240Updated this week
• circlemind-ai / fast-graphrag
  RAG that intelligently adapts to your use case, data, and queries
  ☆3,042Updated 3 weeks ago
• langroid / langroid
  Harness LLMs with Multi-Agent Programming
  ☆3,171Updated this week
• AnswerDotAI / rerankers
  A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.
  ☆1,338Updated last month
• lancedb / lancedb
  Developer-friendly, embedded retrieval engine for multimodal AI. Search More; Manage Less.
  ☆5,922Updated this week
• arcee-ai / mergekit
  Tools for merging pretrained large language models.
  ☆5,458Updated this week
• langfuse / langfuse
  🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with Open…
  ☆9,536Updated this week