Continuous Integration for LLM powered applications
☆259Aug 11, 2023Updated 2 years ago
Alternatives and similar repositories for benchllm
Users that are interested in benchllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A tool for evaluating LLMs☆428Mar 15, 2026Updated 3 months ago
- Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chro…☆3,041Feb 11, 2026Updated 5 months ago
- Highly configurable CLI app for OpenAI's chat/text completion API☆11Nov 8, 2024Updated last year
- Promptimize is a prompt engineering evaluation and testing toolkit.☆495May 25, 2026Updated last month
- 2023 Prompt Complete Collection☆16Jan 3, 2024Updated 2 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Official Code For Dual Grained Quantization: Efficient Fine-Grained Quantization for LLM☆14Dec 27, 2023Updated 2 years ago
- Build your own custom knowledge base from various sources such as youtube videos transcripts, tweets, articles, videos and audios. Uses G…☆13Dec 15, 2023Updated 2 years ago
- Generate chatbots from a corpus☆133Jul 18, 2023Updated 2 years ago
- Generates strongly typed classes for Semantic Kernel using prompt strings.☆15Aug 30, 2025Updated 10 months ago
- Automatic prompt caching for Claude Code. Cuts token costs by up to 90% on repeated file reads, bug fix sessions, and long coding convers…☆127Jun 12, 2026Updated 3 weeks ago
- ☆12Apr 22, 2024Updated 2 years ago
- A Multi-Model AI Assistant - Chatbot☆11Jul 14, 2023Updated 2 years ago
- Run AI models anywhere. https://muna.ai/explore☆85Jul 1, 2026Updated last week
- ☆14Nov 20, 2022Updated 3 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- The LLM Evaluation Framework☆16,685Updated this week
- Research notes and extra resources for all the work at explodinggradients.com☆26Mar 11, 2025Updated last year
- Semantic cache for LLMs. Fully integrated with LangChain and llama_index.☆8,086Jul 11, 2025Updated last year
- Vendor-agnostic orchestration for training, inference and agentic workloads across NVIDIA, AMD, TPU, and Tenstorrent on clouds, Kubernete…☆2,170Updated this week
- ☆48Nov 8, 2023Updated 2 years ago
- 🤖 + 🐳 + 🐧 Monadic Chat is a locally hosted web application designed to create and utilize intelligent chatbots. By providing a Linux e…☆69Updated this week
- Video generation and processing library.☆18Updated this week
- Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.☆865Jan 15, 2024Updated 2 years ago
- LLM Oracle is a GPT-4 powered tool for predicting future events. It's like a Magic 8 Ball that is able to perform basic research, calcula…☆17May 27, 2023Updated 3 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Adding guardrails to large language models.☆7,109Updated this week
- Web application that allows you to interact with biomedical knowledge graphs and query biomedical questions.☆31Sep 20, 2023Updated 2 years ago
- Custom AI agent platform to speed up your work.☆1,409Updated this week
- RAG orchestration framework ⛵️☆205Jul 12, 2025Updated 11 months ago
- ☆40Feb 5, 2026Updated 5 months ago
- Blueprints is an open-source tool that integrates with your text editor to help you generate code with an LLM based on patterns you alrea…☆61Sep 9, 2024Updated last year
- A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.☆12,311May 25, 2026Updated last month
- Holistic Evaluation of Language Models (HELM) is an open source Python framework created by the Center for Research on Foundation Models …☆2,846Jul 1, 2026Updated last week
- Scale LLM Engine public repository☆833Jul 4, 2026Updated last week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- A simple wrapper for OpenAI to log input/outputs.☆106Aug 28, 2023Updated 2 years ago
- Lnu-AI: Storyteller☆19Aug 24, 2024Updated last year
- Contains all scripts and data of blog contents☆10May 3, 2017Updated 9 years ago
- A OpenAI GPT3 based QnA agent for documents and links☆12Jul 11, 2023Updated 3 years ago
- ☆98Jun 19, 2026Updated 3 weeks ago
- Supercharge Your LLM Application Evaluations 🚀☆14,773Feb 24, 2026Updated 4 months ago
- 🤖 Create LLM agents in a second with your prompts. Everything you need to create an LLM Agent - tools, prompts, frameworks, and models -…☆1,900Apr 1, 2026Updated 3 months ago