Continuous Integration for LLM powered applications
☆262Aug 11, 2023Updated 3 years ago
Alternatives and similar repositories for benchllm
Users that are interested in benchllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A tool for evaluating LLMs☆430Mar 15, 2026Updated 7 months ago
- Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chro…☆3,061Feb 11, 2026Updated 8 months ago
- Code for PII detection and redaction in code datasets☆17Jan 24, 2023Updated 3 years ago
- ☆16Jun 22, 2024Updated 2 years ago
- This project provides an AI-driven test case generator using FastAPI. The application accepts a GitHub repository name and generates test…☆20Jun 7, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Promptimize is a prompt engineering evaluation and testing toolkit.☆497Oct 12, 2026Updated 2 weeks ago
- 🧬 [WIP] Lobe Flow - an open-source ai powered node flow editor☆21Updated this week
- A unified orchestration layer for heterogeneous AI compute. It standardizes how to manage compute and run training and inference on GPU c…☆2,293Updated this week
- ☆12Apr 22, 2024Updated 2 years ago
- Build your own custom knowledge base from various sources such as youtube videos transcripts, tweets, articles, videos and audios. Uses G…☆13Dec 15, 2023Updated 2 years ago
- Generate chatbots from a corpus☆132Jul 18, 2023Updated 3 years ago
- ☆16Sep 28, 2025Updated last year
- A Multi-Model AI Assistant - Chatbot☆12Jul 14, 2023Updated 3 years ago
- Prem App it's your personal AI in your pocket☆476Nov 16, 2023Updated 2 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Plan-Validate-Solve (PVS) Agent for accurate, reliable and reproducable workflow automation☆350Sep 25, 2023Updated 3 years ago
- ☆143Jun 30, 2023Updated 3 years ago
- LLM Evals Leaderboard☆50Nov 21, 2023Updated 2 years ago
- The LLM Evaluation Framework☆19,167Updated this week
- Semantic cache for LLMs. Fully integrated with LangChain and llama_index.☆8,216Sep 22, 2026Updated last month
- Machine Learning Serving focused on GenAI with simplicity as the top priority.☆60Oct 5, 2026Updated 3 weeks ago
- A OpenAI GPT3 based QnA agent for documents and links☆12Jul 11, 2023Updated 3 years ago
- PanML is a high level generative AI/ML development and analysis library designed for ease of use and fast experimentation.☆117Jul 8, 2023Updated 3 years ago
- open-source container runtime for quilt.sh☆17Feb 25, 2026Updated 8 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆12Nov 19, 2025Updated 11 months ago
- ☆48Nov 8, 2023Updated 2 years ago
- Run AI models anywhere. https://muna.ai/explore☆86Updated this week
- Contains all scripts and data of blog contents☆10May 3, 2017Updated 9 years ago
- A Ruby on Rails style framework for the DSPy (Demonstrate, Search, Predict) project for Language Models like GPT, BERT, and LLama.☆136Oct 1, 2026Updated 3 weeks ago
- 🍯 Runny: a tool for running things☆18Updated this week
- Research notes and extra resources for all the work at explodinggradients.com☆28Mar 11, 2025Updated last year
- ReLM is a Regular Expression engine for Language Models☆108Jun 2, 2023Updated 3 years ago
- Holistic Evaluation of Language Models (HELM) is an open source Python framework created by the Center for Research on Foundation Models …☆2,960Sep 1, 2026Updated last month
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☁ Open source guide re-defining Cloud computing terms & patterns to better understand how it works☆27Dec 15, 2023Updated 2 years ago
- Adding guardrails to large language models.☆7,567Updated this week
- Extract text from your DOCX documents.☆11Feb 10, 2024Updated 2 years ago
- Web application that allows you to interact with biomedical knowledge graphs and query biomedical questions.☆31Sep 20, 2023Updated 3 years ago
- QDrant-NLP☆12Aug 30, 2022Updated 4 years ago
- [ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling☆1,900Jul 10, 2024Updated 2 years ago
- Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-s…☆2,676Updated this week