Top papers related to LLM-based agent evaluation
☆97Oct 21, 2025Updated 8 months ago
Alternatives and similar repositories for LLM-Agent-Evaluation-Survey
Users that are interested in LLM-Agent-Evaluation-Survey are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- TEAL: New Selection Strategy for Small Buffers in Experience Replay Class Incremental Learning☆18Jan 21, 2025Updated last year
- Official implementation of "Dataset Size Recovery from LoRA Weights" paper.☆34Jun 30, 2024Updated 2 years ago
- Official PyTorch Implementation for the "Unsupervised Model Tree Heritage Recovery" paper (ICLR 2025).☆62Jul 1, 2025Updated last year
- SlamKit is an open source tool kit for efficient training of SpeechLMs. It was used for "Slamming: Training a Speech Language Model on On…☆230Mar 14, 2026Updated 3 months ago
- An official implementation of ProbeGen☆13Oct 20, 2024Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆24May 31, 2024Updated 2 years ago
- 🦄 Unitxt is a Python library for enterprise-grade evaluation of AI performance, offering the world's largest catalog of tools and data …☆216May 27, 2026Updated last month
- An official PyTorch implementation for CLIPPR☆31Jul 22, 2023Updated 2 years ago
- Official PyTorch Implementation for the "Distilling Datasets Into Less Than One Image" paper.☆39Jun 6, 2024Updated 2 years ago
- Official Implementation for the "Back to the Feature: Classical 3D Features are (Almost) All You Need for 3D Anomaly Detection" paper (VA…☆141Nov 28, 2022Updated 3 years ago
- GlotEval: a unified evaluation toolkit designed to benchmark multilingual Large Language Models (LLMs) in a language-specific way☆18Nov 4, 2025Updated 8 months ago
- ☆28Feb 11, 2026Updated 4 months ago
- Repository for "Attribute First, then Generate: Locally-attributable Grounded Text Generation", ACL 2024☆30Dec 19, 2024Updated last year
- Awesome AI Benchmarks☆36Jan 16, 2026Updated 5 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- jQuery, React and Streamlit applications written by LLMs☆15Dec 24, 2023Updated 2 years ago
- Real-Time Deepfake Detection in the Real-World☆50Nov 30, 2024Updated last year
- This repository contains a user-friendly Graphical User Interface (GUI) for interacting with the Hebrew-Mistral-7B language model.☆15May 3, 2024Updated 2 years ago
- QuoteSum is a textual QA dataset containing Semi-Extractive Multi-source Question Answering (SEMQA) examples written by humans, based on …☆13Mar 25, 2024Updated 2 years ago
- The dataset includes widget captions that describes UI element's functionalities. It is used for training and evaluation of the widget ca…☆23Jun 24, 2021Updated 5 years ago
- Experiments on using ChatGPT for failure mode classification☆12Sep 20, 2023Updated 2 years ago
- Official implementation of paper 'Fair Feature Distillation for Visual Recognition'☆17Jun 23, 2021Updated 5 years ago
- A category wise collection of 200+ LLM survey papers.☆296Apr 7, 2025Updated last year
- Pytorch implementation of the paper: "Drop the GAN: In Defense of Patches Nearest Neighbors as Single Image Generative Models"☆67Nov 27, 2021Updated 4 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- We introduce the LLAMA1 Test Set, a comprehensive open-domain world knowledge QA dataset for evaluating question-answering systems. We pr…☆23Mar 14, 2024Updated 2 years ago
- ☆12Mar 5, 2025Updated last year
- Official pytorch re-implementation of "Demystifying Inter-Class Disentanglement", ICLR 2020.☆13Dec 2, 2021Updated 4 years ago
- Survey paper: From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agents.☆72Apr 3, 2026Updated 3 months ago
- A proxy for minimax-m2, enabling interleaved thinking, and tool calls.☆39Nov 21, 2025Updated 7 months ago
- Corpus exploration platform using advanced tools such as interactive summarization and multi document coreference resolution☆12Jun 15, 2023Updated 3 years ago
- ☆26Feb 28, 2025Updated last year
- The predecessor of CiteLab.☆18Feb 3, 2026Updated 5 months ago
- FailureSensorIQ, a dataset and benchmark to probe LLMs’ reasoning and comprehension of sensor–failure relationships in industrial systems…☆46Jul 2, 2026Updated last week
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Automated AI Model Metadata eXtractor - automatically extracts and infers AI model-related from software repositories☆11Sep 21, 2025Updated 9 months ago
- Official repository for NAST: Noise Aware Speech Tokenization for Speech Language Models (Interspeech 2024) https://arxiv.org/abs/2406.11…☆46Jul 2, 2024Updated 2 years ago
- [AAAI'25] The implementation of paper "Federated Foundation Models on Heterogeneous Time Series" | The first work to explore time series …☆24May 10, 2026Updated 2 months ago
- MLflow deployment plugin For IBM-cloud-watson-ml☆15May 7, 2025Updated last year
- Environments, tools, and benchmarks for general computer agents☆17Dec 3, 2024Updated last year
- Codebase for EnterpriseOps-Gym from ServiceNow☆99Updated this week
- make logging fun again☆20Apr 9, 2017Updated 9 years ago