Alternatives and similar repositories for llama-stack

Users that are interested in llama-stack are comparing it to the libraries listed below

• llamastack / llama-stack-apps
  Agentic components of the Llama Stack APIs
  ☆4,288Updated 5 months ago
• pytorch / torchchat
  Run PyTorch LLMs locally on servers, desktop and mobile
  ☆3,624Updated 4 months ago
• openai / swarm
  Educational framework exploring ergonomic, lightweight multi-agent orchestration. Managed by OpenAI Solution team.
  ☆20,855Updated 10 months ago
• Lightning-AI / LitServe
  A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.
  ☆3,792Updated 3 weeks ago
• mistralai / mistral-finetune
  ☆3,070Updated 2 months ago
• predibase / lorax
  Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
  ☆3,684Updated 8 months ago
• meta-pytorch / torchtune
  PyTorch native post-training library
  ☆5,654Updated this week
• NVIDIA / nv-ingest
  NeMo Retriever extraction is a scalable, performance-oriented document content and metadata extraction microservice. NeMo Retriever extra…
  ☆2,830Updated this week
• awslabs / agent-squad
  Flexible and powerful framework for managing multiple AI agents and handling complex conversations
  ☆7,303Updated last week
• lm-sys / RouteLLM
  A framework for serving and evaluating LLM routers - save LLM costs without compromising quality
  ☆4,568Updated last year
• AgentOps-AI / agentops
  Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including C…
  ☆5,232Updated 3 months ago
• huggingface / smollm
  Everything about the SmolLM and SmolVLM family of models
  ☆3,579Updated 2 weeks ago
• run-llama / llama_cloud_services
  Knowledge Agents and Management in the Cloud
  ☆4,231Updated this week
• fixie-ai / ultravox
  A fast multimodal LLM for real-time voice
  ☆4,334Updated last month
• landing-ai / vision-agent
  Vision agent
  ☆5,208Updated last week
• meta-llama / llama-models
  Utilities intended for use with Llama models.
  ☆7,446Updated 3 weeks ago
• mistralai / cookbook
  ☆2,150Updated 3 weeks ago
• huggingface / smol-course
  A course on aligning smol models.
  ☆6,577Updated 2 months ago
• meta-llama / llama-cookbook
  Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We als…
  ☆18,167Updated 2 months ago
• vllm-project / aibrix
  Cost-efficient and pluggable Infrastructure components for GenAI inference
  ☆4,589Updated last week
• facebookresearch / lingua
  Meta Lingua: a lean, efficient, and easy-to-hack codebase to research LLMs.
  ☆4,752Updated 6 months ago
• microsoft / PhiCookBook
  This is a Phi Family of SLMs book for getting started with Phi Models. Phi a family of open sourced AI models developed by Microsoft. Phi…
  ☆3,656Updated last week
• MadcowD / ell
  A language model programming library.
  ☆5,877Updated 7 months ago
• microsoft / TinyTroupe
  LLM-powered multiagent persona simulation for imagination enhancement and business insights.
  ☆7,194Updated last month
• facebookresearch / large_concept_model
  Large Concept Models: Language modeling in a sentence representation space
  ☆2,332Updated last year
• anthropics / claude-quickstarts
  A collection of projects designed to help developers quickly get started with building deployable applications using the Claude API
  ☆13,664Updated last week
• transformerlab / transformerlab-app
  Open Source Machine Learning Research Platform designed for frontier AI/ML workflows. Local, on-prem, or in the cloud. Open source.
  ☆4,757Updated this week
• pydantic / pydantic-ai
  GenAI Agent Framework, the Pydantic way
  ☆14,536Updated this week
• EricLBuehler / mistral.rs
  Blazingly fast LLM inference.
  ☆6,379Updated last week
• mlabonne / llm-datasets
  Curated list of datasets and tools for post-training.
  ☆4,205Updated 2 months ago