A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use cases, promote the adoption of best practices in LLM assessment, and critically assess the effectiveness of these evaluation methods.
☆190Apr 30, 2026Updated last month
Alternatives and similar repositories for LLMEvaluation
Users that are interested in LLMEvaluation are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Bangla TTS Inference pipeline using Vit TTS☆13Mar 24, 2024Updated 2 years ago
- A framework for few-shot evaluation of autoregressive language models.☆13Feb 14, 2024Updated 2 years ago
- A project for implementing ML and NLP papers☆13May 22, 2020Updated 6 years ago
- [ICML 2025] Official implementation of the paper "SkipGPT: Dynamic Layer Pruning Reinvented with Token Awareness and Module Decoupling". …☆23Nov 17, 2025Updated 6 months ago
- This is code for How Do Social Bots Participate in Misinformation Spread? A Comprehensive Dataset and Analysis☆18Nov 5, 2025Updated 6 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- RACF (Recency Aware Collaborative Filtering) is the implementation of the "Recency Aware Collaborative Filtering for Next Basket Recommen…☆25Feb 15, 2025Updated last year
- Fine-tune Bangla ASR model which was trained Bangla Mozilla Common Voice Dataset☆12Apr 16, 2024Updated 2 years ago
- Awesome Bangla Datasets☆46Mar 29, 2025Updated last year
- ☆17Nov 23, 2023Updated 2 years ago
- ☆13May 30, 2024Updated last year
- Inspect: A framework for large language model evaluations☆2,137Updated this week
- ☆24Dec 12, 2024Updated last year
- Experimental CUDA kernel framework unifying typed dimensions, NVRTC JIT specialization, and ML‑guided tuning.☆46Feb 9, 2026Updated 3 months ago
- Experiments to assess SPADE on different LLM pipelines.☆17Apr 7, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Notebooks demonstrating example applications of the cleanvision library☆17Dec 16, 2025Updated 5 months ago
- Deploy automl models for tabular tasks on AWS Sagemaker with AutoGluon☆13Feb 28, 2020Updated 6 years ago
- My configuration files, loosely inspired by @sontek☆38May 13, 2026Updated 2 weeks ago
- A tool that can be used to measure the sequential performance of any OpenAI-compatible LLM API☆24Aug 1, 2024Updated last year
- KL3M training data collection and preprocessing☆22Apr 14, 2025Updated last year
- Universal LLM security auditor with automated jailbreak testing, DSPy optimization, and OWASP 2025-aligned attack patterns☆21Oct 23, 2025Updated 7 months ago
- [ACL 2024 Findings] Light-PEFT: Lightening Parameter-Efficient Fine-Tuning via Early Pruning☆13Sep 2, 2024Updated last year
- SeeGULL is a broad-coverage stereotype dataset in English containing stereotypes about identity groups spanning 178 countries across 8 di…☆38Sep 25, 2023Updated 2 years ago
- Speeech Recognition for Indic languages.☆13Apr 3, 2021Updated 5 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Python library for Evaluation☆17Mar 31, 2026Updated last month
- Tutorials and related talks given by the aeon community☆20Oct 11, 2025Updated 7 months ago
- This repository contains the code and data for the paper "VisOnlyQA: Large Vision Language Models Still Struggle with Visual Perception o…☆29Jul 9, 2025Updated 10 months ago
- LLM query engine to retrieve augmented responses from json files.☆15Oct 12, 2023Updated 2 years ago
- Cookbooks showcasing various applications of Cleanlab☆22Jan 20, 2026Updated 4 months ago
- Python client library for Cleanlab Trustworthy Language Model☆24Dec 9, 2025Updated 5 months ago
- ☆12Feb 16, 2024Updated 2 years ago
- ☆16Jun 28, 2024Updated last year
- Code for the NeurIPS 2020 paper "Improved analysis of clippind algorithms for non-convex optimization", including various clipping algori…☆10Feb 17, 2021Updated 5 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Evaluate your model using advanced prompt strategies☆21Jan 30, 2026Updated 3 months ago
- This is the official code for the EMNLP findings 2025 paper "Enhancing Time Awareness in Generative Recommendation".☆18Aug 30, 2025Updated 9 months ago
- 无人机+人工智能工程实践项目的学习笔记☆13Mar 1, 2019Updated 7 years ago
- C++ inference wrappers for running blazing fast embedding services on your favourite serverless like AWS Lambda. By Prithivi Da, PRs welc…☆23Mar 4, 2024Updated 2 years ago
- ☆17Jul 23, 2025Updated 10 months ago
- Text Summarization in Pytorch The aim of this project is to build a text summarizer that summarize Amazon Reviews.☆10Jun 7, 2018Updated 7 years ago
- German dataset for DPR model training☆19Jul 21, 2024Updated last year