Continuous Integration for LLM powered applications
☆255Aug 11, 2023Updated 2 years ago
Alternatives and similar repositories for benchllm
Users that are interested in benchllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A tool for evaluating LLMs☆428Mar 15, 2026Updated 2 weeks ago
- Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chro…☆3,029Feb 11, 2026Updated last month
- This is a HubSpot clone Application built with DhiWise. It uses HubSpot APIs to store and retrieve data.☆13Sep 28, 2022Updated 3 years ago
- Highly configurable CLI app for OpenAI's chat/text completion API☆11Nov 8, 2024Updated last year
- Javascripts☆11Mar 1, 2026Updated 3 weeks ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Automatic prompt caching for Claude Code. Cuts token costs by up to 90% on repeated file reads, bug fix sessions, and long coding convers…☆89Updated this week
- Promptimize is a prompt engineering evaluation and testing toolkit.☆494Mar 16, 2026Updated last week
- The Company Intranet is a centralised platform for managing and sharing company information. Sync employee data from KEKA and access impo…☆11Mar 15, 2023Updated 3 years ago
- 2023 Prompt Complete Collection☆16Jan 3, 2024Updated 2 years ago
- Official Repo for the Paper "AI as Humanity's Salieri: Quantifying Linguistic Creativity of Language Models via Systematic Attribution o…☆24Jan 12, 2025Updated last year
- Build your own custom knowledge base from various sources such as youtube videos transcripts, tweets, articles, videos and audios. Uses G…☆13Dec 15, 2023Updated 2 years ago
- PanML is a high level generative AI/ML development and analysis library designed for ease of use and fast experimentation.☆117Jul 8, 2023Updated 2 years ago
- Generate chatbots from a corpus☆132Jul 18, 2023Updated 2 years ago
- Generates strongly typed classes for Semantic Kernel using prompt strings.☆15Aug 30, 2025Updated 6 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- Solving the "Flow Free" game (mobile app) with Clojure and SAT☆11Jun 22, 2019Updated 6 years ago
- ☆12Apr 22, 2024Updated last year
- The LLM Evaluation Framework☆14,227Mar 20, 2026Updated last week
- A Multi-Model AI Assistant - Chatbot☆11Jul 14, 2023Updated 2 years ago
- ☆19Sep 21, 2022Updated 3 years ago
- Machine Learning Serving focused on GenAI with simplicity as the top priority.☆59Jan 5, 2026Updated 2 months ago
- Semantic cache for LLMs. Fully integrated with LangChain and llama_index.☆7,970Jul 11, 2025Updated 8 months ago
- Research notes and extra resources for all the work at explodinggradients.com☆26Mar 11, 2025Updated last year
- dstack is an open-source control plane for running development, training, and inference jobs on GPUs—across hyperscalers, neoclouds, or o…☆2,069Mar 23, 2026Updated last week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- An Autonomous Curriculum Reinforcement Learning framework that steers agents to continually learn in specific environments with zero huma…☆26Feb 25, 2026Updated last month
- 🤖 + 🐳 + 🐧 Monadic Chat is a locally hosted web application designed to create and utilize intelligent chatbots. By providing a Linux e…☆67Mar 5, 2026Updated 3 weeks ago
- Minimal video generation and processing library.☆12Updated this week
- Identify and automatically fix issues in shell scripts☆15Nov 24, 2023Updated 2 years ago
- Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.☆867Jan 15, 2024Updated 2 years ago
- LLM Oracle is a GPT-4 powered tool for predicting future events. It's like a Magic 8 Ball that is able to perform basic research, calcula…☆19May 27, 2023Updated 2 years ago
- 🍯 Runny: a tool for running things☆17Mar 19, 2026Updated last week
- Adding guardrails to large language models.☆6,585Updated this week
- An application that automatically generates Python codes based on GPT (as used in ChatGPT).☆46Oct 10, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- Web application that allows you to interact with biomedical knowledge graphs and query biomedical questions.☆31Sep 20, 2023Updated 2 years ago
- A blazing fast AI Gateway with integrated guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.☆11,080Updated this week
- Custom AI agent platform to speed up your work.☆1,313Updated this week
- RAG orchestration framework ⛵️☆204Jul 12, 2025Updated 8 months ago
- Blueprints is an open-source tool that integrates with your text editor to help you generate code with an LLM based on patterns you alrea…☆60Sep 9, 2024Updated last year
- Supercharge Your LLM Application Evaluations 🚀☆13,106Feb 24, 2026Updated last month
- ☆41Feb 5, 2026Updated last month