Alternatives and similar repositories for awesome-tool-llm:

Users that are interested in awesome-tool-llm are comparing it to the libraries listed below

• bigai-nlco / LooGLE
  ACL 2024 | LooGLE: Long Context Evaluation for Long-Context Language Models
  ☆173Updated 3 months ago
• hkust-nlp / AgentBoard
  An Analytical Evaluation Board of Multi-turn LLM Agents
  ☆272Updated 8 months ago
• StonyBrookNLP / appworld
  🌍 Repository for "AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agent", ACL'24 Best Resource Pap…
  ☆136Updated last month
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆208Updated 2 months ago
• GAIR-NLP / ReAlign
  Reformatted Alignment
  ☆113Updated 4 months ago
• OpenBMB / InfiniteBench
  Codes for the paper "∞Bench: Extending Long Context Evaluation Beyond 100K Tokens": https://arxiv.org/abs/2402.13718
  ☆306Updated 4 months ago
• GAIR-NLP / ProX
  Offical Repo for "Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale"
  ☆209Updated 3 months ago
• xingyaoww / mint-bench
  Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Ziha…
  ☆110Updated 7 months ago
• zhangxjohn / LLM-Agent-Benchmark-List
  A banchmark list for evaluation of large language models.
  ☆79Updated 6 months ago
• SuperBruceJia / Awesome-LLM-Self-Consistency
  Awesome LLM Self-Consistency: a curated list of Self-consistency in Large Language Models
  ☆86Updated 5 months ago
• TIGER-AI-Lab / MAmmoTH2
  Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]
  ☆131Updated 3 months ago
• sambanova / toolbench
  ToolBench, an evaluation suite for LLM tool manipulation capabilities.
  ☆148Updated 11 months ago
• QwenLM / ProcessBench
  ☆129Updated last month
• ZubinGou / math-evaluation-harness
  A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨
  ☆153Updated 9 months ago
• THUNLP-MT / StableToolBench
  A new tool learning benchmark aiming at well-balanced stability and reality, based on ToolBench.
  ☆126Updated 4 months ago
• NumberChiffre / mcts-llm
  ☆88Updated last month
• zjunlp / AutoAct
  [ACL 2024] AUTOACT: Automatic Agent Learning from Scratch for QA via Self-Planning
  ☆203Updated 2 weeks ago
• QwenLM / AutoIF
  ☆251Updated 6 months ago
• rxlqn / awesome-llm-self-reflection
  augmented LLM with self reflection
  ☆110Updated last year
• Ber666 / ToolkenGPT
  ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool Embeddings - NeurIPS 2023 (oral)
  ☆254Updated 9 months ago
• zjunlp / WKM
  [NeurIPS 2024] Agent Planning with World Knowledge Model
  ☆104Updated last month
• zorazrw / agent-workflow-memory
  AWM: Agent Workflow Memory
  ☆233Updated 2 months ago
• xlang-ai / Spider2-V
  [NeurIPS 2024] Spider2-V: How Far Are Multimodal Agents From Automating Data Science and Engineering Workflows?
  ☆116Updated 5 months ago
• night-chen / ToolQA
  ToolQA, a new dataset to evaluate the capabilities of LLMs in answering challenging questions with external tools. It offers two levels …
  ☆249Updated last year
• anchen1011 / FireAct
  FireAct: Toward Language Agent Fine-tuning
  ☆261Updated last year
• HowieHwong / MetaTool
  [ICLR 2024] MetaTool Benchmark for Large Language Models: Deciding Whether to Use Tools and Which to Use
  ☆76Updated 10 months ago
• google-deepmind / loft
  LOFT: A 1 Million+ Token Long-Context Benchmark
  ☆168Updated 3 months ago
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆141Updated 9 months ago
• SALT-NLP / DyLAN
  Official Implementation of Dynamic LLM-Agent Network: An LLM-agent Collaboration Framework with Agent Team Optimization
  ☆126Updated 8 months ago
• hkust-nlp / llm-compression-intelligence
  Official github repo for the paper "Compression Represents Intelligence Linearly" [COLM 2024]
  ☆130Updated 4 months ago