GPT-4 を用いて、言語モデルの応答を自動評価するスクリプト
☆16Jun 6, 2024Updated last year
Alternatives and similar repositories for gpt4-autoeval
Users that are interested in gpt4-autoeval are comparing it to the libraries listed below
Sorting:
- A framework for few-shot evaluation of autoregressive language models.☆12Jul 14, 2025Updated 7 months ago
- ☆12Jan 11, 2026Updated last month
- [CVPR2024] Learning from Synthetic Human Group Activities☆14Feb 24, 2025Updated last year
- A Swedish Natural Language Understanding Benchmark☆11Dec 12, 2025Updated 2 months ago
- DOMAINEVAL is an auto-constructed benchmark for multi-domain code generation that consists of 2k+ subjects (i.e., description, reference …☆14Dec 12, 2024Updated last year
- Survey of available speech datasets for Polish ASR development☆17Jan 1, 2025Updated last year
- The official Python library for Openlayer, the Continuous Model Improvement Platform for AI. 📈☆16Feb 25, 2026Updated last week
- Code for paper: "Executing Arithmetic: Fine-Tuning Large Language Models as Turing Machines"☆11Oct 11, 2024Updated last year
- benchmarks for evaluating MT models☆11Jun 26, 2024Updated last year
- ☆12May 30, 2025Updated 9 months ago
- LLM red teaming datasets from the paper 'Student-Teacher Prompting for Red Teaming to Improve Guardrails' for the ART of Safety Workshop …☆22Oct 12, 2023Updated 2 years ago
- ☆11Oct 15, 2022Updated 3 years ago
- Code for our project CROWN (Conversational Passage Ranking by Reasoning over Word Networks)☆10Jan 11, 2024Updated 2 years ago
- ☆12Mar 5, 2025Updated last year
- ☆11Jan 3, 2024Updated 2 years ago
- Align, a general text alignment function☆15Dec 7, 2023Updated 2 years ago
- A system for managing files and file replicas across many diverse sites☆11Mar 23, 2023Updated 2 years ago
- Dataset for AAAI paper "Natural Language Inference in Context - Investigating Contextual Reasoning over Long Texts"☆11Nov 18, 2022Updated 3 years ago
- Website for release of TellMeWhy dataset for why question answering☆14Nov 11, 2022Updated 3 years ago
- ☆12Nov 5, 2024Updated last year
- Code and Data for GlitchBench☆13Feb 27, 2024Updated 2 years ago
- ☆11Nov 5, 2024Updated last year
- 中文金融大模型测评基准，六大类二十五任务、等级化评价，国内模型获得A级☆10May 6, 2024Updated last year
- Meta-specification framework for AI Agents to generate Spec-driven X toolkits automatically.☆28Nov 22, 2025Updated 3 months ago
- Explore Pusheen Pics!☆12Dec 4, 2014Updated 11 years ago
- Basic ChatBot using CTransformers, ChromaDB and Gradio. Configured for CPU.☆12Nov 23, 2023Updated 2 years ago
- 中文原生等级化代码能力测试基准☆15Apr 11, 2024Updated last year
- My implementation of diffusion (like) models☆11Apr 14, 2023Updated 2 years ago
- ☆12Jul 6, 2024Updated last year
- An LSTM model implemented by PyTorch to perform sentiment classification on the Stanford Sentiment Treebank (SST-5) dataset.☆11Sep 13, 2022Updated 3 years ago
- an auto-sleeping and -waking framework around llama.cpp☆12Feb 8, 2025Updated last year
- Chinese Generation Evaluation☆13Aug 14, 2023Updated 2 years ago
- [LREC-Coling 2024] PECC: Problem Extraction and Coding Challenges☆14May 30, 2024Updated last year
- Demo scripts for HPS Dataset (http://virtualhumans.mpi-inf.mpg.de/hps/)☆11Mar 10, 2025Updated 11 months ago
- CopyBench: Measuring Literal and Non-Literal Reproduction of Copyright-Protected Text in Language Model Generation☆14Aug 19, 2025Updated 6 months ago
- A Dronekit based APM connector☆11May 18, 2017Updated 8 years ago
- Use LLMs to clean your gmail inbox☆20Dec 23, 2023Updated 2 years ago
- RACE is a multi-dimensional benchmark for code generation that focuses on Readability, mAintainability, Correctness, and Efficiency.☆12Oct 12, 2024Updated last year
- LGEB: Benchmark of Language Generation Evaluation☆16Oct 21, 2022Updated 3 years ago