Continuous Integration for LLM powered applications
☆262Aug 11, 2023Updated 3 years ago
Alternatives and similar repositories for benchllm
Users that are interested in benchllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A tool for evaluating LLMs☆430Mar 15, 2026Updated 6 months ago
- Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chro…☆3,055Feb 11, 2026Updated 7 months ago
- Highly configurable CLI app for OpenAI's chat/text completion API☆11Jul 28, 2026Updated last month
- ☆17Jun 22, 2024Updated 2 years ago
- Official Code For Dual Grained Quantization: Efficient Fine-Grained Quantization for LLM☆14Dec 27, 2023Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- 2023 Prompt Complete Collection☆16Jan 3, 2024Updated 2 years ago
- Promptimize is a prompt engineering evaluation and testing toolkit.☆498May 25, 2026Updated 3 months ago
- ☆14Nov 20, 2022Updated 3 years ago
- Build your own custom knowledge base from various sources such as youtube videos transcripts, tweets, articles, videos and audios. Uses G…☆13Dec 15, 2023Updated 2 years ago
- A self-extending MCP server☆22Apr 10, 2026Updated 5 months ago
- PanML is a high level generative AI/ML development and analysis library designed for ease of use and fast experimentation.☆117Jul 8, 2023Updated 3 years ago
- Generate chatbots from a corpus☆132Jul 18, 2023Updated 3 years ago
- ☆12Apr 22, 2024Updated 2 years ago
- A Multi-Model AI Assistant - Chatbot☆11Jul 14, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Generates strongly typed classes for Semantic Kernel using prompt strings.☆15Aug 30, 2025Updated last year
- Run AI models anywhere. https://muna.ai/explore☆86Sep 3, 2026Updated 2 weeks ago
- Flask API for generating text embeddings using OpenAI or sentence_transformers☆14Sep 1, 2023Updated 3 years ago
- Research notes and extra resources for all the work at explodinggradients.com☆27Mar 11, 2025Updated last year
- My plugins for the Pants build system☆13Aug 24, 2026Updated 3 weeks ago
- A Python library for building GPT-powered agents with state machine logic and chat history memory.☆75Jan 2, 2024Updated 2 years ago
- Machine Learning Serving focused on GenAI with simplicity as the top priority.☆60Jul 6, 2026Updated 2 months ago
- Semantic cache for LLMs. Fully integrated with LangChain and llama_index.☆8,192Jul 11, 2025Updated last year
- Vendor-agnostic orchestration for training, inference and agentic workloads across NVIDIA, AMD, TPU, and Tenstorrent on clouds, Kubernete…☆2,252Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆48Nov 8, 2023Updated 2 years ago
- A OpenAI GPT3 based QnA agent for documents and links☆12Jul 11, 2023Updated 3 years ago
- 🤖 + 🐳 + 🐧 Monadic Chat is a locally hosted web application designed to create and utilize intelligent chatbots. By providing a Linux e…☆70Updated this week
- Contains all scripts and data of blog contents☆10May 3, 2017Updated 9 years ago
- Generic Differential Evolution for Rust☆21Sep 12, 2016Updated 10 years ago
- An application that automatically generates Python codes based on GPT (as used in ChatGPT).☆45Oct 10, 2023Updated 2 years ago
- 🍯 Runny: a tool for running things☆18Jul 28, 2026Updated last month
- Web application that allows you to interact with biomedical knowledge graphs and query biomedical questions.☆31Sep 20, 2023Updated 2 years ago
- Kel - CLI-based AI assistant☆34Jan 7, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Adding guardrails to large language models.☆7,425Updated this week
- The LLM Evaluation Framework☆18,312Updated this week
- Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.☆869Jan 15, 2024Updated 2 years ago
- LLM Oracle is a GPT-4 powered tool for predicting future events. It's like a Magic 8 Ball that is able to perform basic research, calcula…☆18May 27, 2023Updated 3 years ago
- Extract text from your DOCX documents.☆11Feb 10, 2024Updated 2 years ago
- Custom AI agent platform to speed up your work.☆1,467Updated this week
- Blueprints is an open-source tool that integrates with your text editor to help you generate code with an LLM based on patterns you alrea…☆62Sep 9, 2024Updated 2 years ago