babelcloud / LLM-RGB
LLM Reasoning and Generation Benchmark. Evaluate LLMs in complex scenarios systematically.
☆149Updated 3 weeks ago
Alternatives and similar repositories for LLM-RGB:
Users that are interested in LLM-RGB are comparing it to the libraries listed below
- This is the official repo for "PromptAgent: Strategic Planning with Language Models Enables Expert-level Prompt Optimization". PromptAgen…☆242Updated 6 months ago
- [ACL 2024] AUTOACT: Automatic Agent Learning from Scratch for QA via Self-Planning☆206Updated last month
- [NAACL 2025] KnowAgent: Knowledge-Augmented Planning for LLM-Based Agents☆207Updated 3 weeks ago
- ☆121Updated 2 weeks ago
- ☆153Updated 5 months ago
- Compress your input to ChatGPT or other LLMs, to let them process 2x more content and save 40% memory and GPU time.☆356Updated last year
- Official Repo for ICML 2024 paper "Executable Code Actions Elicit Better LLM Agents" by Xingyao Wang, Yangyi Chen, Lifan Yuan, Yizhe Zhan…☆600Updated 8 months ago
- Official implementation of paper "On the Diagram of Thought" (https://arxiv.org/abs/2409.10038)☆172Updated 4 months ago
- ☆91Updated 2 months ago
- ☆294Updated 10 months ago
- An Analytical Evaluation Board of Multi-turn LLM Agents [NeurIPS 2024 Oral]☆281Updated 9 months ago
- [ACL 2024 Demo] Official GitHub repo for UltraEval: An open source framework for evaluating foundation models.☆233Updated 3 months ago
- Evaluating LLMs' multi-round chatting capability via assessing conversations generated by two LLM instances.☆144Updated last year
- ☆166Updated 2 months ago
- ☆51Updated 6 months ago
- ☆28Updated 5 months ago
- [ICLR 2025] The official implementation of paper "ToolGen: Unified Tool Retrieval and Calling via Generation"☆125Updated 2 months ago
- Official repo for "LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMs".☆220Updated 5 months ago
- AI for all: Build the large graph of the language models☆254Updated 8 months ago
- ☆304Updated 5 months ago
- FireAct: Toward Language Agent Fine-tuning☆265Updated last year
- ☆98Updated 2 months ago
- ☆209Updated 9 months ago
- My implementation of "Algorithm of Thoughts: Enhancing Exploration of Ideas in Large Language Models"☆97Updated last year
- connecting humans and agents☆69Updated 2 months ago
- ☆139Updated 7 months ago
- ToolBench, an evaluation suite for LLM tool manipulation capabilities.☆150Updated 11 months ago
- 🦀️ CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agents. https://crab.camel-ai.org/☆213Updated 2 months ago
- SuperCLUE-Agent: 基于中文原生任务的Agent智能体核心能力测评基准☆81Updated last year
- The official repository for the paper: Evaluation of Retrieval-Augmented Generation: A Survey.☆129Updated 4 months ago