Continuous Integration for LLM powered applications
☆262Aug 11, 2023Updated 3 years ago
Alternatives and similar repositories for benchllm
Users that are interested in benchllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A tool for evaluating LLMs☆428Mar 15, 2026Updated 8 months ago
- Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chro…☆3,060Feb 11, 2026Updated 9 months ago
- The open source metrics layer☆51Nov 11, 2026Updated last week
- ☆16Jun 22, 2024Updated 2 years ago
- This project provides an AI-driven test case generator using FastAPI. The application accepts a GitHub repository name and generates test…☆20Jun 7, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Promptimize is a prompt engineering evaluation and testing toolkit.☆496Nov 2, 2026Updated 2 weeks ago
- 🧬 [WIP] Lobe Flow - an open-source ai powered node flow editor☆21Oct 23, 2026Updated 3 weeks ago
- Build your own custom knowledge base from various sources such as youtube videos transcripts, tweets, articles, videos and audios. Uses G…☆13Dec 15, 2023Updated 2 years ago
- A unified orchestration layer for heterogeneous AI compute. It standardizes how to manage compute and run training and inference on GPU c…☆2,315Updated this week
- Generate chatbots from a corpus☆132Jul 18, 2023Updated 3 years ago
- ☆12Nov 10, 2025Updated last year
- ☆16Sep 28, 2025Updated last year
- Prem App it's your personal AI in your pocket☆478Nov 16, 2023Updated 3 years ago
- ☆12Apr 22, 2024Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Plan-Validate-Solve (PVS) Agent for accurate, reliable and reproducable workflow automation☆351Sep 25, 2023Updated 3 years ago
- ☆144Jun 30, 2023Updated 3 years ago
- open-source container runtime for quilt.sh☆17Feb 25, 2026Updated 8 months ago
- ☆52Feb 23, 2024Updated 2 years ago
- LLM Evals Leaderboard☆50Nov 21, 2023Updated 2 years ago
- Framework for Self-Organizing Python Agents☆29Feb 4, 2024Updated 2 years ago
- Semantic cache for LLMs. Fully integrated with LangChain and llama_index.☆8,233Sep 22, 2026Updated last month
- Machine Learning Serving focused on GenAI with simplicity as the top priority.☆60Oct 5, 2026Updated last month
- PanML is a high level generative AI/ML development and analysis library designed for ease of use and fast experimentation.☆117Jul 8, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The LLM Evaluation Framework☆19,547Updated this week
- ☆12Nov 19, 2025Updated 11 months ago
- ☆48Nov 8, 2023Updated 3 years ago
- Run AI models anywhere. https://muna.ai/explore☆86Nov 10, 2026Updated last week
- Research notes and extra resources for all the work at explodinggradients.com☆29Mar 11, 2025Updated last year
- Holistic Evaluation of Language Models (HELM) is an open source Python framework created by the Center for Research on Foundation Models …☆2,974Sep 1, 2026Updated 2 months ago
- ReLM is a Regular Expression engine for Language Models☆108Jun 2, 2023Updated 3 years ago
- Adding guardrails to large language models.☆7,620Updated this week
- Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-s…☆2,682Nov 5, 2026Updated 2 weeks ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A guidance language for controlling large language models.☆21,827May 21, 2026Updated 5 months ago
- [ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling☆1,905Jul 10, 2024Updated 2 years ago
- Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.☆869Jan 15, 2024Updated 2 years ago
- Lnu-AI: Storyteller☆19Aug 24, 2024Updated 2 years ago
- RAG orchestration framework ⛵️☆204Jul 12, 2025Updated last year
- Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML va…☆4,068Dec 28, 2025Updated 10 months ago
- Scale LLM Engine public repository☆843Updated this week
Are these results useful?