Awesome LLM Benchmarks to evaluate the LLMs across text, code, image, audio, video and more.
☆161Jan 3, 2024Updated 2 years ago
Alternatives and similar repositories for awesome-LLM-benchmarks
Users that are interested in awesome-LLM-benchmarks are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Awesome-LLM-Eval: a curated list of tools, datasets/benchmark, demos, leaderboard, papers, docs and models, mainly for Evaluation on LLMs…☆631Nov 24, 2025Updated 4 months ago
- 中国大模型☆6,425Nov 30, 2024Updated last year
- 面向大模型的民族文化数据集☆12May 26, 2025Updated 10 months ago
- A complete guide to evaluate LLMs and RAGs. Both theory and code based approaches covered.☆28Nov 16, 2023Updated 2 years ago
- Code for Chinese grammatical error correction based on knowledge distillation☆11Aug 16, 2022Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- autogen 中文文档☆10Nov 7, 2023Updated 2 years ago
- A super lightweight, ultra high-performance React UI library.☆17Nov 15, 2023Updated 2 years ago
- Scalable Meta-Evaluation of LLMs as Evaluators☆43Feb 15, 2024Updated 2 years ago
- Dilation Gate CNN For Machine Reading Comprehension☆17Mar 24, 2023Updated 3 years ago
- This is the official repository of the paper "Atomic-to-Compositional Generalization for Mobile Agents with A New Benchmark and Schedulin…☆13Jul 27, 2025Updated 8 months ago
- Scorer for grammatical error correction systems.☆14Feb 24, 2016Updated 10 years ago
- Official github repo for SafetyBench, a comprehensive benchmark to evaluate LLMs' safety. [ACL 2024]☆282Jul 28, 2025Updated 8 months ago
- Intelligent Code Analysis by Computer Vision Techniques and Application to Vulnerability Prediction☆10May 10, 2021Updated 4 years ago
- ☆34Updated this week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Repository for NPHardEval, a quantified-dynamic benchmark of LLMs☆64Mar 26, 2024Updated 2 years ago
- SuperCLUE: 中文通用大模型综合性基准 | A Benchmark for Foundation Models in Chinese☆3,278Feb 6, 2026Updated 2 months ago
- Comic Colorization with cGAN☆14Dec 19, 2018Updated 7 years ago
- Qwen-Efficient-Tuning☆44Aug 16, 2023Updated 2 years ago
- Official Implementation of NIPS 2022 paper Pre-activation Distributions Expose Backdoor Neurons☆15Jan 13, 2023Updated 3 years ago
- 模型 llava-Qwen2-7B-Instruct-Chinese-CLIP 增强中文文字识别能力和表情包内涵识别能力，接近gpt4o、claude-3.5-sonnet的识别水平！☆27Jul 23, 2024Updated last year
- ☆12Jul 31, 2025Updated 8 months ago
- This is the official repository of the paper Exploring Superior Function Calls via Reinforcement Learning.☆34Aug 11, 2025Updated 8 months ago
- This is the implementation of CounterCurate, the data curation pipeline of both physical and semantic counterfactual image-caption pairs.☆19Jun 27, 2024Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆84Apr 7, 2026Updated last week
- ☆18Feb 20, 2025Updated last year
- Evolutionary Multi-objective Optimization based Neural Architecture Search for Cognitive Diagnosis☆12Sep 5, 2024Updated last year
- ☆27Sep 11, 2024Updated last year
- [ACL 2025] Research code for the paper "OS-Kairos: Adaptive Interaction for MLLM-Powered GUI Agents"☆20Jun 19, 2025Updated 9 months ago
- ☆71Jan 20, 2026Updated 2 months ago
- OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, …☆6,866Updated this week
- 利用大模型LLM对中文文本、图片以及pdf中的非结构化文本内容进行分析，并提取主-谓-宾（SPO）三元组的知识形式，以及将这些关系可视化为知识图谱。The large LLM model is used to analyze the unstructured text co…☆26Apr 16, 2025Updated 11 months ago
- R-Judge: Benchmarking Safety Risk Awareness for LLM Agents (EMNLP Findings 2024)☆101Jan 11, 2026Updated 3 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- 受到self-instruct启发,除了通用LLM还能做垂直领域的小LLM实现定制效果，通过GPT获得question和answer来作为训练数据☆18May 12, 2023Updated 2 years ago
- Time series data contribution via influence functions☆17Jan 18, 2025Updated last year
- 大创项目，层级注意力机器翻译☆17Apr 12, 2021Updated 5 years ago
- Unofficial Implementation of Evolutionary Model Merging☆41Mar 28, 2024Updated 2 years ago
- ☆19Mar 15, 2025Updated last year
- 如需体验textin文档解析，请点击https://cc.co/16YSIy☆128Jun 28, 2025Updated 9 months ago
- A concise implementation of SimCSE☆16Aug 2, 2021Updated 4 years ago