Alternatives and similar repositories for prompt-ops

Users that are interested in prompt-ops are comparing it to the libraries listed below

• NVIDIA-NeMo / DataDesigner
  🎨 NeMo Data Designer: A general library for generating high-quality synthetic data from scratch or based on seed data.
  ☆674Updated this week
• meta-llama / synthetic-data-kit
  Tool for generating high quality Synthetic datasets
  ☆1,476Updated 3 months ago
• huggingface / yourbench
  🤗 Benchmark Large Language Models Reliably On Your Data
  ☆425Updated last month
• always-further / deepfabric
  Generate High-Quality Synthetics, Train, Measure, and Evaluate in a Single Pipeline
  ☆827Updated this week
• langchain-ai / agentevals
  Readymade evaluators for agent trajectories
  ☆467Updated 4 months ago
• rango-ramesh / advanced-chunker
  Semantic Chunker is a lightweight Python package for semantically-aware chunking and clustering of text.
  ☆293Updated 9 months ago
• sisig-ai / doctor
  Doctor is a tool for discovering, crawl, and indexing web sites to be exposed as an MCP server for LLM agents.
  ☆461Updated 8 months ago
• langchain-ai / openevals
  Readymade evaluators for your LLM apps
  ☆889Updated last month
• argilla-io / synthetic-data-generator
  Build datasets using natural language
  ☆559Updated 4 months ago
• meta-pytorch / OpenEnv
  An interface library for RL post training with environments.
  ☆1,090Updated last week
• mozilla-ai / any-agent
  A single interface to use and evaluate different agent frameworks
  ☆1,089Updated this week
• vectara / open-rag-eval
  RAG evaluation without the need for "golden answers"
  ☆338Updated last month
• alvarobartt / hf-mem
  A CLI to estimate inference memory requirements for Hugging Face models, written in Python.
  ☆501Updated last week
• neuml / annotateai
  📝 Automatically annotate papers using LLMs
  ☆401Updated 2 months ago
• cvs-health / uqlm
  UQLM: Uncertainty Quantification for Language Models, is a Python package for UQ-based LLM hallucination detection
  ☆1,101Updated last week
• letta-ai / agent-file
  Agent File (.af): An open file format for serializing stateful AI agents with persistent memory and behavior. Share, checkpoint, and vers…
  ☆990Updated this week
• togethercomputer / open_deep_research
  Together Open Deep Research
  ☆356Updated 9 months ago
• huggingface / gpt-oss-recipes
  Collection of scripts and notebooks for OpenAI's latest GPT OSS models
  ☆496Updated 5 months ago
• cfahlgren1 / observers
  A Lightweight Library for AI Observability
  ☆255Updated 11 months ago
• ishanExtreme / a2a_mcp-example
  An example showing how A2A and MCP can be used together
  ☆183Updated 8 months ago
• langchain-ai / langconnect
  A managed RAG API server.
  ☆335Updated 8 months ago
• run-llama / llamacloud-mcp
  ☆222Updated 6 months ago
• huggingface / huggingface-gemma-recipes
  Inference, Fine Tuning and many more recipes with Gemma family of models
  ☆279Updated 6 months ago
• groq / openbench
  Provider-agnostic, open-source evaluation infrastructure for language models
  ☆714Updated last month
• safety-research / petri
  An alignment auditing agent capable of quickly exploring alignment hypothesis
  ☆863Updated last week
• diffbot / diffbot-llm-inference
  DIffbot LLM Inference Server
  ☆227Updated 5 months ago
• huggingface / screenenv
  A powerful Python library for creating and managing isolated desktop environments using Docker containers.
  ☆448Updated 4 months ago
• anyscale / llm-router
  Tutorial for building LLM router
  ☆242Updated last year
• cuga-project / cuga-agent
  CUGA is an open-source generalist agent for the enterprise, supporting complex task execution on web and APIs, OpenAPI/MCP integrations, …
  ☆665Updated last week
• run-llama / multi-agent-concierge
  An example of multi-agent orchestration with llama-index
  ☆446Updated last year