langfuse / oss-llmops-stackLinks
Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-availability, while Langfuse focuses on detailed observability, prompt versioning, and performance evaluations.
☆119Updated 8 months ago
Alternatives and similar repositories for oss-llmops-stack
Users that are interested in oss-llmops-stack are comparing it to the libraries listed below
Sorting:
- simplifies the process of creating and managing LLM workflows.☆109Updated last year
- Rank LLMs, RAG systems, and prompts using automated head-to-head evaluation☆105Updated 10 months ago
- Tools for LLM agents.☆60Updated 10 months ago
- Chat strategies for LLMs☆105Updated last year
- Flowchart-like UI to interconnect LLM's and Huggingface models, and deploy them as a REST API with little to no code.☆72Updated 7 months ago
- Build reliable, secure, and production-ready AI apps easily.☆86Updated last week
- Pixelagent — Multimodal stateful agents☆218Updated 4 months ago
- Benchmark and optimize LLM inference across frameworks with ease☆124Updated last month
- ☆80Updated last month
- Sculpt: Structuring unstructured data with LLMs☆36Updated last month
- Build super simple end-to-end data & ETL pipelines for your vector databases and Generative AI applications☆104Updated last year
- ☆171Updated last year
- Routing on Random Forest (RoRF)☆214Updated last year
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)☆79Updated 8 months ago
- Jigsawstack Python SDK☆18Updated 2 weeks ago
- QLLM: A powerful CLI for seamless interaction with multiple Large Language Models. Simplify AI workflows, streamline development, and unl…☆34Updated 6 months ago
- ☆152Updated 3 months ago
- RAG orchestration framework ⛵️☆201Updated 3 months ago
- An MCP server for loading skills (shim for non-claude clients).☆35Updated last week
- Not Diamond Python SDK☆89Updated last week
- ⚡ Bhumi – The fastest AI inference client for Python, built with Rust for unmatched speed, efficiency, and scalability 🚀☆61Updated 2 weeks ago
- A framework for building large-scale, deterministic, interactive workflows with a fault-tolerant, conversational UX☆40Updated this week
- augini: AI-Powered Tabular Data Assistant☆32Updated 8 months ago
- This codebase demonstrates various DSPy functionalities through practical examples.☆50Updated 8 months ago
- ☆148Updated this week
- Shared Memory Storage for Multi-Agent Systems☆126Updated 3 months ago
- Deploy any AI model, agent, database, RAG, and pipeline locally or remotely in minutes☆560Updated this week
- ☆246Updated last year
- Personal project, Generative AI, Streamlit, Python☆54Updated 5 months ago
- Foyle is a copilot to help developers deploy and operate their applications.☆133Updated 7 months ago