Alternatives and similar repositories for llama-stack

Users that are interested in llama-stack are comparing it to the libraries listed below

• llamastack / llama-stack-apps
  Agentic components of the Llama Stack APIs
  ☆4,288Updated 5 months ago
• lm-sys / RouteLLM
  A framework for serving and evaluating LLM routers - save LLM costs without compromising quality
  ☆4,502Updated last year
• awslabs / agent-squad
  Flexible and powerful framework for managing multiple AI agents and handling complex conversations
  ☆7,179Updated last week
• pydantic / pydantic-ai
  GenAI Agent Framework, the Pydantic way
  ☆14,122Updated this week
• pytorch / torchchat
  Run PyTorch LLMs locally on servers, desktop and mobile
  ☆3,622Updated 3 months ago
• SylphAI-Inc / AdalFlow
  AdalFlow: The library to build & auto-optimize LLM applications.
  ☆3,958Updated this week
• openai / swarm
  Educational framework exploring ergonomic, lightweight multi-agent orchestration. Managed by OpenAI Solution team.
  ☆20,757Updated 9 months ago
• meta-llama / llama-cookbook
  Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We als…
  ☆18,136Updated 2 months ago
• run-llama / llama_cloud_services
  Knowledge Agents and Management in the Cloud
  ☆4,227Updated 3 weeks ago
• Lightning-AI / LitServe
  A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.
  ☆3,766Updated this week
• stanfordnlp / dspy
  DSPy: The framework for programming—not prompting—language models
  ☆31,170Updated last week
• mistralai / mistral-finetune
  ☆3,056Updated last month
• mistralai / cookbook
  ☆2,132Updated 3 weeks ago
• langchain-ai / open-canvas
  📃 A better UX for chat, writing content, and coding with LLMs.
  ☆5,258Updated last week
• microsoft / PhiCookBook
  This is a Phi Family of SLMs book for getting started with Phi Models. Phi a family of open sourced AI models developed by Microsoft. Phi…
  ☆3,641Updated this week
• predibase / lorax
  Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
  ☆3,661Updated 7 months ago
• meta-llama / llama-models
  Utilities intended for use with Llama models.
  ☆7,423Updated this week
• microsoft / LLMLingua
  [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…
  ☆5,736Updated 2 months ago
• AgentOps-AI / agentops
  Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including C…
  ☆5,176Updated 2 months ago
• livekit / agents
  A powerful framework for building realtime voice AI agents 🤖🎙️📹
  ☆8,906Updated this week
• truefoundry / cognita
  RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry
  ☆4,309Updated last month
• run-llama / llama_deploy
  Deploy your agentic worfklows to production
  ☆2,067Updated 3 weeks ago
• cohere-ai / cohere-toolkit
  Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.
  ☆3,155Updated last week
• andrewyng / aisuite
  Simple, unified interface to multiple Generative AI providers
  ☆13,315Updated 3 weeks ago
• NVIDIA / nv-ingest
  NeMo Retriever extraction is a scalable, performance-oriented document content and metadata extraction microservice. NeMo Retriever extra…
  ☆2,791Updated last week
• huggingface / cookbook
  Open-source AI cookbook
  ☆2,568Updated 2 months ago
• timescale / pgai
  A suite of tools to develop RAG, semantic search, and other AI applications more easily with PostgreSQL
  ☆5,593Updated last week
• EricLBuehler / mistral.rs
  Blazingly fast LLM inference.
  ☆6,318Updated this week
• microsoft / PromptWizard
  Task-Aware Agent-driven Prompt Optimization Framework
  ☆3,736Updated 2 months ago
• microsoft / graphrag
  A modular graph-based Retrieval-Augmented Generation (RAG) system
  ☆30,175Updated this week