tensorchord / Awesome-LLMOpsLinks
An awesome & curated list of best LLMOps tools for developers
☆5,557Updated 2 weeks ago
Alternatives and similar repositories for Awesome-LLMOps
Users that are interested in Awesome-LLMOps are comparing it to the libraries listed below
Sorting:
- Adding guardrails to large language models.☆6,248Updated last week
- Evaluation and Tracking for LLM Experiments and AI Agents☆3,033Updated last week
- 😎 Awesome list of tools and projects with the awesome LangChain framework☆9,077Updated last week
- NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.☆5,492Updated this week
- Supercharge Your LLM Application Evaluations 🚀☆12,148Updated last week
- AI Observability & Evaluation☆8,184Updated this week
- Semantic cache for LLMs. Fully integrated with LangChain and llama_index.☆7,901Updated 6 months ago
- Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chro…☆2,991Updated last year
- The LLM Evaluation Framework☆13,012Updated this week
- A comprehensive guide to building RAG-based LLM applications for production.☆1,845Updated last year
- Structured Outputs☆13,237Updated this week
- Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, 20+ clouds, o…☆9,215Updated this week
- Large Language Model Text Generation Inference☆10,728Updated last week
- Numbers every LLM developer should know☆4,278Updated 2 years ago
- A language for constraint-guided and efficient LLM programming.☆4,126Updated 7 months ago
- Harness LLMs with Multi-Agent Programming☆3,841Updated this week
- A library of data loaders for LLMs made by the community -- to be used with LlamaIndex and/or LangChain☆3,482Updated last year
- Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs☆3,671Updated 7 months ago
- AdalFlow: The library to build & auto-optimize LLM applications.☆3,977Updated 2 weeks ago
- A framework for serving and evaluating LLM routers - save LLM costs without compromising quality☆4,525Updated last year
- Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engin…☆4,530Updated 11 months ago
- ☆1,279Updated last year
- Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean…☆13,588Updated this week
- Build Conversational AI in minutes ⚡️☆11,364Updated this week
- Modular Python framework for AI agents and workflows with chain-of-thought reasoning, tools, and memory.☆2,455Updated this week
- Superfast AI decision making and intelligent processing of multi-modal data.☆3,161Updated last month
- Test your prompts, agents, and RAGs. AI Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude,…☆9,826Updated this week
- A real world full-stack application using LlamaIndex☆2,582Updated 10 months ago
- Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)☆12,677Updated last week
- General technology for enabling AI capabilities w/ LLMs and MLLMs☆4,255Updated 3 weeks ago