☆241Nov 27, 2025Updated 10 months ago
Alternatives and similar repositories for lmeval
Users that are interested in lmeval are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- JAX Scalify: end-to-end scaled arithmetics☆18Oct 30, 2024Updated last year
- Repo hosting codes and materials related to speeding LLMs' inference using token merging.☆37Oct 9, 2025Updated last year
- Universal LLM security auditor with automated jailbreak testing, DSPy optimization, and OWASP 2025-aligned attack patterns☆22Oct 23, 2025Updated 11 months ago
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆2,564Oct 6, 2026Updated last week
- Genetics for Language Models☆18Jul 1, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Online materials for Social Media Data Analysis at the University of Konstanz☆10Oct 13, 2025Updated last year
- Gorilla: An API store for LLMs☆10Jun 28, 2024Updated 2 years ago
- 🐜🔧 A minimalistic tool to fine-tune your LLMs☆21Aug 17, 2023Updated 3 years ago
- ☆60Nov 18, 2025Updated 11 months ago
- A framework for few-shot evaluation of language models.☆14,260Sep 14, 2026Updated last month
- Reading diffusion language models for decisions: same OpenJev model, one pass instead of 3.65, +5 points, calibrated, no training. Plus c…☆27Sep 29, 2026Updated 2 weeks ago
- Fast Multimodal Semantic Deduplication & Filtering☆975Oct 4, 2026Updated 2 weeks ago
- We release Open Meditron, a fully open, clinician-audited medical training corpus and evaluation protocol that closes the open-vs-closed …☆19Aug 3, 2026Updated 2 months ago
- 📚 A curated list of papers & technical articles on AI Quality & Safety☆226Apr 14, 2025Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Understanding the correlation between different LLM benchmarks☆30Jan 11, 2024Updated 2 years ago
- Practical Jupyter notebooks from Andrew Ng and Giskard team's "Red Teaming LLM Applications" course on DeepLearning.AI.☆24Apr 8, 2024Updated 2 years ago
- Put your data somewhere you can look at it☆34Jun 9, 2025Updated last year
- An unofficial implementation of SOLAR-10.7B model and the newly proposed interlocked-DUS(iDUS) implementation and experiment details.☆14Mar 20, 2024Updated 2 years ago
- ☆57Nov 6, 2024Updated last year
- The LLM Evaluation Framework☆18,935Updated this week
- A collection of various llm pruning implementations, training code for GPUs & TPUs, and evaluation script.☆75Apr 20, 2026Updated 5 months ago
- lm15 for Python: one request and response model for every AI model provider. The reference implementation; standard library only. pip ins…☆30Updated this week
- ☆146Sep 29, 2026Updated 2 weeks ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- A framework for optimizing DSPy programs with RL☆339Jan 12, 2026Updated 9 months ago
- Readymade evaluators for your LLM apps☆1,225Updated this week
- The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System☆184Jun 13, 2024Updated 2 years ago
- Evaluate your LLM's response with Prometheus and GPT4 💯☆1,120Apr 25, 2025Updated last year
- AI Observability & Evaluation☆11,897Updated this week
- MCP-based Agent Deep Evaluation System☆155Jun 2, 2026Updated 4 months ago
- Low-Cost LLM-Powered Data Processing with Theoretical Guarantees☆61Jun 11, 2026Updated 4 months ago
- Composable metric reporters in Python.☆14Jun 6, 2024Updated 2 years ago
- Transforming textual descriptions into process models using deep learning☆15May 16, 2019Updated 7 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Synthetic data curation for post-training and structured data extraction☆1,749Updated this week
- ☆13Feb 7, 2023Updated 3 years ago
- Plug-and-play document AI with zero-shot models.☆126May 11, 2026Updated 5 months ago
- ☆21Oct 5, 2026Updated 2 weeks ago
- A lightweight record-replay reverse proxy for testing☆23Jul 24, 2026Updated 2 months ago
- Minimalistic large language model 3D-parallelism training☆2,843Oct 8, 2026Updated last week
- Open GenAI Stack☆8,441Updated this week