babelcloud / LLM-RGBLinks
LLM Reasoning and Generation Benchmark. Evaluate LLMs in complex scenarios systematically.
☆166Updated 8 months ago
Alternatives and similar repositories for LLM-RGB
Users that are interested in LLM-RGB are comparing it to the libraries listed below
Sorting:
- Compress your input to ChatGPT or other LLMs, to let them process 2x more content and save 40% memory and GPU time.☆409Updated last year
- ☆159Updated last year
- ☆278Updated 2 years ago
- ☆67Updated last year
- [ACL 2024] AutoAct: Automatic Agent Learning from Scratch for QA via Self-Planning☆233Updated last year
- Beating the GAIA benchmark with Transformers Agents. 🚀☆144Updated 11 months ago
- FireAct: Toward Language Agent Fine-tuning☆291Updated 2 years ago
- Official implementation of paper "On the Diagram of Thought" (https://arxiv.org/abs/2409.10038)☆191Updated this week
- Langchain implementation of HuggingGPT☆134Updated 2 years ago
- ☆320Updated last year
- This is the official repo for "PromptAgent: Strategic Planning with Language Models Enables Expert-level Prompt Optimization". PromptAgen…☆347Updated 6 months ago
- Complex question answering in LLMs with enhanced reasoning and information-seeking capabilities.☆204Updated 2 years ago
- NexusRaven-13B, a new SOTA Open-Source LLM for function calling. This repo contains everything for reproducing our evaluation on NexusRav…☆318Updated 2 years ago
- Benchmark baseline for retrieval qa applications☆119Updated last year
- ToolBench, an evaluation suite for LLM tool manipulation capabilities.☆172Updated last year
- Code for Husky, an open-source language agent that solves complex, multi-step reasoning tasks. Husky v1 addresses numerical, tabular and …☆346Updated last year
- Evaluating tool-augmented LLMs in conversation settings☆88Updated last year
- [ACL 2024 Demo] Official GitHub repo for UltraEval: An open source framework for evaluating foundation models.☆254Updated last year
- ☆186Updated last year
- This repository contains the paper list for the paper: Igniting Language Intelligence: The Hitchhiker's Guide From Chain-of-Thought Reaso…☆367Updated 2 years ago
- Generative Judge for Evaluating Alignment☆249Updated 2 years ago
- The evaluation benchmark on MCP servers☆236Updated 4 months ago
- [ICLR 2025] A trinity of environments, tools, and benchmarks for general virtual agents☆221Updated 7 months ago
- [ICLR 2025] The official implementation of paper "ToolGen: Unified Tool Retrieval and Calling via Generation"☆172Updated 10 months ago
- Official repo for "LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMs".☆241Updated last year
- Self-Reflection in LLM Agents: Effects on Problem-Solving Performance☆93Updated last year
- ToolQA, a new dataset to evaluate the capabilities of LLMs in answering challenging questions with external tools. It offers two levels …☆285Updated 2 years ago
- ☆132Updated 2 years ago
- ☆317Updated last year
- Build Hierarchical Autonomous Agents through Config. Collaborative Growth of Specialized Agents.☆324Updated 2 years ago