tensorchord / Awesome-LLMOps
An awesome & curated list of best LLMOps tools for developers
☆4,299Updated last week
Alternatives and similar repositories for Awesome-LLMOps:
Users that are interested in Awesome-LLMOps are comparing it to the libraries listed below
- 😎 Awesome list of tools and projects with the awesome LangChain framework☆7,850Updated 5 months ago
- Adding guardrails to large language models.☆4,404Updated this week
- Supercharge Your LLM Application Evaluations 🚀☆7,963Updated this week
- A comprehensive guide to building RAG-based LLM applications for production.☆1,749Updated 5 months ago
- Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chro…☆2,769Updated 5 months ago
- Numbers every LLM developer should know☆4,152Updated last year
- Harness LLMs with Multi-Agent Programming☆2,965Updated this week
- [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…☆4,828Updated this week
- Build resilient language agents as graphs.☆8,448Updated this week
- Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.☆9,885Updated this week
- AI Observability & Evaluation☆4,579Updated this week
- NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.☆4,357Updated last week
- Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engin…☆3,374Updated 10 months ago
- Semantic cache for LLMs. Fully integrated with LangChain and llama_index.☆7,358Updated 4 months ago
- Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Ge…☆5,271Updated this week
- Superfast AI decision making and intelligent processing of multi-modal data.☆2,326Updated this week
- 🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with Llam…☆8,065Updated this week
- Go ahead and axolotl questions☆8,395Updated this week
- DSPy: The framework for programming—not prompting—language models☆21,461Updated this week
- General technology for enabling AI capabilities w/ LLMs and MLLMs☆3,806Updated 2 weeks ago
- Build Conversational AI in minutes ⚡️☆8,369Updated this week
- AdalFlow: The library to build & auto-optimize LLM applications.☆2,495Updated this week
- A Bulletproof Way to Generate Structured JSON from Language Models☆4,549Updated 11 months ago
- Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sag…☆16,637Updated this week
- A framework for serving and evaluating LLM routers - save LLM costs without compromising quality☆3,490Updated 5 months ago
- structured outputs for llms☆9,057Updated this week
- A library of data loaders for LLMs made by the community -- to be used with LlamaIndex and/or LangChain☆3,464Updated 10 months ago
- Evaluation and Tracking for LLM Experiments☆2,293Updated this week
- Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs☆2,321Updated this week
- Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…☆3,197Updated 4 months ago