nlpyang / gevalLinks
Code for paper "G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment"
☆404Updated last year
Alternatives and similar repositories for geval
Users that are interested in geval are comparing it to the libraries listed below
Sorting:
- SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models☆597Updated last year
- Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"☆218Updated last year
- This is the repository of HaluEval, a large-scale hallucination evaluation benchmark for Large Language Models.☆549Updated last year
- Source Code of Paper "GPTScore: Evaluate as You Desire"☆259Updated 2 years ago
- A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic…☆414Updated 9 months ago
- [EMNLP 2023] Enabling Large Language Models to Generate Text with Citations. Paper: https://arxiv.org/abs/2305.14627☆507Updated last year
- [ICLR 2024 & NeurIPS 2023 WS] An Evaluator LM that is open-source, offers reproducible evaluation, and inexpensive to use. Specifically d…☆309Updated 2 years ago
- Comprehensive benchmark for RAG☆258Updated 7 months ago
- RefChecker provides automatic checking pipeline and benchmark dataset for detecting fine-grained hallucinations generated by Large Langua…☆414Updated 8 months ago
- ☆295Updated 2 years ago
- Data and code for FreshLLMs (https://arxiv.org/abs/2310.03214)☆386Updated 2 months ago
- This is a repository for sharing papers in the field of persona-based conversational AI. The related source code for each paper is linked…☆168Updated last year
- ☆188Updated 6 months ago
- ToolQA, a new dataset to evaluate the capabilities of LLMs in answering challenging questions with external tools. It offers two levels …☆285Updated 2 years ago
- Evaluate your LLM's response with Prometheus and GPT4 💯☆1,032Updated 9 months ago
- Official implementation for the paper "DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models"☆533Updated last year
- Multilingual Large Language Models Evaluation Benchmark☆133Updated last year
- ACL2023 - AlignScore, a metric for factual consistency evaluation.☆148Updated last year
- Calculate perplexity on a text with pre-trained language models. Support MLM (eg. DeBERTa), recurrent LM (eg. GPT3), and encoder-decoder …☆165Updated 7 months ago
- Do-Not-Answer: A Dataset for Evaluating Safeguards in LLMs☆306Updated last year
- Code and data for "Lost in the Middle: How Language Models Use Long Contexts"☆374Updated 2 years ago
- [NeurIPS 2023] Codebase for the paper: "Guiding Large Language Models with Directional Stimulus Prompting"☆111Updated 2 years ago
- [ICLR 2024 Spotlight] FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets☆218Updated 2 years ago
- Repository for Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions, ACL23☆247Updated last year
- ☆168Updated 3 months ago
- A Survey of Attributions for Large Language Models☆221Updated 2 weeks ago
- Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.☆165Updated 2 years ago
- Contriever: Unsupervised Dense Information Retrieval with Contrastive Learning☆768Updated 2 years ago
- Repository for EMNLP 2022 Paper: Towards a Unified Multi-Dimensional Evaluator for Text Generation☆214Updated last year
- [EMNLP 2023] The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning☆253Updated 2 years ago