v7labs / benchllmLinks
Continuous Integration for LLM powered applications
☆241Updated last year
Alternatives and similar repositories for benchllm
Users that are interested in benchllm are comparing it to the libraries listed below
Sorting:
- A tool for evaluating LLMs☆418Updated last year
- Python client library for improving your LLM app accuracy☆98Updated 3 months ago
- LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!☆81Updated last year
- Plan-Validate-Solve (PVS) Agent for accurate, reliable and reproducable workflow automation☆335Updated last year
- Domain Adapted Language Modeling Toolkit - E2E RAG☆322Updated 6 months ago
- ⛓️ build cognitive systems, pythonic☆336Updated 6 months ago
- Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.☆301Updated 2 weeks ago
- 🎸 Integrating AI plugins to LLMs☆230Updated last year
- Get 100% uptime, reliability from OpenAI. Handle Rate Limit, Timeout, API, Keys Errors☆654Updated last year
- A framework for event based autonomous multi-agent systems.☆305Updated 8 months ago
- A simple Python sandbox for helpful LLM data agents☆264Updated 11 months ago
- Record and replay LLM interactions for langchain☆82Updated 11 months ago
- A voice-enabled chatbot application built using of 🦜️🔗 LangChain, text-to-speech, and speech-to-text models from 🤗 Hugging Face, and …☆191Updated last year
- ☆74Updated last year
- ☆220Updated last year
- Build robust LLM applications with true composability 🔗☆419Updated last year
- wandbot is a technical support bot for Weights & Biases' AI developer tools that can run in Discord, Slack, ChatGPT and Zendesk☆300Updated 2 weeks ago
- syntactic sugar 🍭 for langchain☆233Updated 7 months ago
- Fiddler Auditor is a tool to evaluate language models.☆181Updated last year
- A Ruby on Rails style framework for the DSPy (Demonstrate, Search, Predict) project for Language Models like GPT, BERT, and LLama.☆125Updated 7 months ago
- LLM fine-tuning and eval☆346Updated last year
- Directly Connecting Python to LLMs via Strongly-Typed Functions, Dataclasses, Interfaces & Generic Types☆399Updated 3 months ago
- Superagent Python SDK☆139Updated last year
- ☆164Updated last year
- 🦜💯 Flex those feathers!☆246Updated 7 months ago
- TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…☆114Updated last year
- Local LLM ReAct Agent with Guidance☆158Updated 2 years ago
- An Intelligence Operating System☆327Updated this week
- Tuning and Evaluation of RAG pipeline. (Automated optimization to be added soon)☆264Updated last year
- ☆185Updated last year