IAAR-Shanghai / UHGEval
[ACL 2024] User-friendly evaluation framework: Eval Suite & Benchmarks: UHGEval, HaluEval, HalluQA, etc.
☆161Updated 5 months ago
Alternatives and similar repositories for UHGEval:
Users that are interested in UHGEval are comparing it to the libraries listed below
- Controllable Text Generation for Large Language Models: A Survey☆167Updated 7 months ago
- notes for Multi-hop Reading Comprehension and open-domain question answering☆85Updated 2 years ago
- Grimoire is All You Need for Enhancing Large Language Models☆113Updated last year
- This includes the original implementation of CtrlA: Adaptive Retrieval-Augmented Generation via Inherent Control.☆60Updated 6 months ago
- Explore concepts like Self-Correct, Self-Refine, Self-Improve, Self-Contradict, Self-Play, and Self-Knowledge, alongside o1-like reasonin…☆164Updated 4 months ago
- [EMNLP 2023] FreeAL: Towards Human-Free Active Learning in the Era of Large Language Models☆87Updated last year
- We leverage 14 datasets as OOD test data and conduct evaluations on 8 NLU tasks over 21 popularly used models. Our findings confirm that …☆94Updated last year
- ☆119Updated last month
- The framework to prune LLMs to any size and any config.☆91Updated last year
- DeepRetrieval - Hacking 🔥Real Search Engines and Retrievers with LLM via RL☆328Updated this week
- Codebase for Iterative DPO Using Rule-based Rewards☆234Updated last week
- A curated list of awesome papers related to adversarial attacks and defenses for information retrieval. If I missed any papers, feel free…☆214Updated 9 months ago
- ✨ A synthetic dataset generation framework that produces diverse coding questions and verifiable solutions - all in one framwork☆189Updated last week
- A Unified Intermediate Representation for Graph Query Languages☆65Updated 2 years ago
- MPLSandbox is an out-of-the-box multi-programming language sandbox designed to provide unified and comprehensive feedback from compiler a…☆174Updated 2 weeks ago
- ☆102Updated last year
- The official repository of our survey paper: "Towards a Unified View of Preference Learning for Large Language Models: A Survey"☆170Updated 5 months ago
- Benchmarking LLMs via Uncertainty Quantification☆220Updated last year
- This tool(enhance_long) aims to enhance the LlaMa2 long context extrapolation capability in the lowest-cost approach, preferably without …☆45Updated last year
- The official repo for paper, LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods.☆336Updated 3 months ago
- adds Sequence Parallelism into LLaMA-Factory☆448Updated last week
- [ACL2024 Findings] Towards Better Question Generation in QA-based Event Extraction☆46Updated last month
- [ACL 24 main] Large Language Models Can Learn Temporal Reasoning☆50Updated 4 months ago
- [ACL 2024 Main] NewsBench: A Systematic Evaluation Framework for Assessing Editorial Capabilities of Large Language Models in Chinese Jou…☆29Updated 9 months ago
- This is the repo for the paper "OS Agents: A Survey on MLLM-based Agents for Computer, Phone and Browser Use".☆238Updated 2 weeks ago
- Code and data for crosstalk text generation tasks, exploring whether large models and pre-trained language models can understand humor. …☆144Updated 2 years ago
- [ACL 2024] CodeScope: An Execution-based Multilingual Multitask Multidimensional Benchmark for Evaluating LLMs on Code Understanding and …☆97Updated 8 months ago
- Reverse Chain-of-Thought Problem Generation for Geometric Reasoning in Large Multimodal Models☆170Updated 5 months ago
- 使用deepspeed从头开始训练一个LLM,经过pretrain和sft阶段,验证llm学习知识、理解语言、回答问题的能力☆147Updated 9 months ago
- 从预训练到强化学习的中文llama2☆88Updated last year