IAAR-Shanghai / UHGEval
[ACL 2024] User-friendly evaluation framework: Eval Suite & Benchmarks: UHGEval, HaluEval, HalluQA, etc.
☆160Updated 4 months ago
Alternatives and similar repositories for UHGEval:
Users that are interested in UHGEval are comparing it to the libraries listed below
- Controllable Text Generation for Large Language Models: A Survey☆163Updated 6 months ago
- notes for Multi-hop Reading Comprehension and open-domain question answering☆85Updated 2 years ago
- This includes the original implementation of CtrlA: Adaptive Retrieval-Augmented Generation via Inherent Control.☆60Updated 5 months ago
- Explore concepts like Self-Correct, Self-Refine, Self-Improve, Self-Contradict, Self-Play, and Self-Knowledge, alongside o1-like reasonin…☆161Updated 3 months ago
- Grimoire is All You Need for Enhancing Large Language Models☆112Updated last year
- [EMNLP 2023] FreeAL: Towards Human-Free Active Learning in the Era of Large Language Models☆86Updated last year
- We leverage 14 datasets as OOD test data and conduct evaluations on 8 NLU tasks over 21 popularly used models. Our findings confirm that …☆94Updated last year
- The framework to prune LLMs to any size and any config.☆89Updated last year
- DeepRetrieval - Hacking 🔥Real Search Engines and Text/Data Retrievers with LLM + RL☆196Updated this week
- ☆116Updated last week
- The official repo for paper, LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods.☆306Updated 3 months ago
- MPLSandbox is an out-of-the-box multi-programming language sandbox designed to provide unified and comprehensive feedback from compiler a…☆174Updated this week
- Codebase for Iterative DPO Using Rule-based Rewards☆227Updated last month
- ✨ A synthetic dataset generation framework that produces diverse coding questions and verifiable solutions - all in one framwork☆170Updated this week
- ☆100Updated last year
- A Unified Intermediate Representation for Graph Query Languages☆65Updated 2 years ago
- [ACL 24 main] Large Language Models Can Learn Temporal Reasoning☆49Updated 3 months ago
- Code and Checkpoints for "Generate rather than Retrieve: Large Language Models are Strong Context Generators" in ICLR 2023.☆281Updated 2 years ago
- This tool(enhance_long) aims to enhance the LlaMa2 long context extrapolation capability in the lowest-cost approach, preferably without …☆45Updated last year
- A curated list of awesome papers related to adversarial attacks and defenses for information retrieval. If I missed any papers, feel free…☆214Updated 8 months ago
- 从预训练到强化学习的中文llama2☆88Updated last year
- Benchmarking LLMs via Uncertainty Quantification☆214Updated last year
- A Comprehensive Benchmark for Code Information Retrieval.☆73Updated last month
- [ACL 2024 Main] NewsBench: A Systematic Evaluation Framework for Assessing Editorial Capabilities of Large Language Models in Chinese Jou…☆29Updated 9 months ago
- Reverse Chain-of-Thought Problem Generation for Geometric Reasoning in Large Multimodal Models☆171Updated 4 months ago
- 使用deepspeed从头开始训练一个LLM,经过pretrain和sft阶段,验证llm学习知识、理解语言、回答问题的能力☆147Updated 8 months ago
- adds Sequence Parallelism into LLaMA-Factory☆432Updated this week
- Recipes to train the self-rewarding reasoning LLMs.☆207Updated 3 weeks ago
- This is the repo for the paper "OS Agents: A Survey on MLLM-based Agents for Computer, Phone and Browser Use".☆229Updated last month
- Chinese large language model☆117Updated last year