Evaluating LLMs' abilities to generate structural output [TMLR2025]
☆24Oct 22, 2026Updated 3 weeks ago
Alternatives and similar repositories for StructEval
Users that are interested in StructEval are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆50Jun 7, 2025Updated last year
- VideoEval-Pro: Robust and Realistic Long Video Understanding Evaluation [TMLR26]☆15Jun 1, 2026Updated 5 months ago
- SWE-QA-Pro: A Representative Benchmark and Scalable Training Recipe for Repository-Level Code Understanding [ACL 2026]☆15Jun 26, 2026Updated 4 months ago
- Quick Long Video Understanding [TMLR2025]☆79Oct 27, 2025Updated last year
- Code and data for the paper FROM ATOMIC TO COMPOSITE: REINFORCEMENT LEARNING ENABLES GENERALIZATION IN COMPLEMENTARY REASONING☆15Oct 15, 2026Updated last month
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Data visualization code generation benchmark: Evaluates LLMs' ability to generate visualization code from DataFrame descriptions.☆13Nov 28, 2025Updated 11 months ago
- The official repo for "AceCoder: Acing Coder RL via Automated Test-Case Synthesis" [ACL25]☆100Apr 9, 2025Updated last year
- Interface for GenAI-Arena [NeurIPS24]☆16Feb 27, 2024Updated 2 years ago
- The official repo for “Unleashing the Reasoning Potential of Pre-trained LLMs by Critique Fine-Tuning on One Problem” [EMNLP25]☆33Sep 1, 2025Updated last year
- Safe Python Code Execution Environment for Language Models☆17Nov 9, 2026Updated last week
- ☆16Updated this week
- Training Coder Models with Critique Reinforcement Learning [ICLR26]☆13Apr 11, 2026Updated 7 months ago
- Landing page + leaderboard for SWE-Bench benchmark☆16Sep 1, 2026Updated 2 months ago
- Notebook on computer science, linguistics, deep learning, opinions, and life. Making it bilingual (en/zh).☆14May 25, 2026Updated 5 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Brave is a simple visualisation library for NLP information extraction, built on top of embedded BRAT.☆15Dec 25, 2019Updated 6 years ago
- The official implementation of ACL'26 Main Paper: ReviewGrounder: Improving Review Substantiveness with Rubric-Guided, Tool-Integrated Ag…☆17May 10, 2026Updated 6 months ago
- ☆10Jan 13, 2026Updated 10 months ago
- [NeurIPS 25] InfiniPot-V: Memory-Constrained KV Cache Compression for Streaming Video Understanding☆25Jan 25, 2026Updated 9 months ago
- General Reasoner: Advancing LLM Reasoning Across All Domains [NeurIPS25]☆233Nov 27, 2025Updated 11 months ago
- Awesome Dev Containers template for developing a trading bot.☆14Dec 3, 2022Updated 3 years ago
- The official repo for "VisualWebInstruct: Scaling up Multimodal Instruction Data through Web Search" [EMNLP25]☆39Feb 1, 2026Updated 9 months ago
- Code for EMNLP25 paper "Video-RTS: Rethinking Reinforcement Learning and Test-Time Scaling for Efficient and Enhanced Video Reasoning"☆24Feb 18, 2026Updated 9 months ago
- Accelerating RL for LLM Reasoning with Optimal Advantage Regression☆41May 30, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- This repo contains the code for "MEGA-Bench Scaling Multimodal Evaluation to over 500 Real-World Tasks" [ICLR 2025]☆83Jul 1, 2025Updated last year
- GraphDancer: Training LLMs to Explore and Reason over Graphs via Curriculum Reinforcement Learning☆21Oct 18, 2026Updated last month
- explainable-machine-translation-metrics☆12Jul 15, 2022Updated 4 years ago
- The benchmark tasks and evaluation harness for "PhysicianBench: Evaluating LLM Agents in Real-World EHR Environments".☆72Aug 13, 2026Updated 3 months ago
- Multi-Agent LLM Evaluation Docs: https://maseval.readthedocs.io/☆43Oct 6, 2026Updated last month
- Official repository for the paper "DR-DCI: Scaling Direct Corpus Interaction via Dynamic Workspace Expansion"☆32Aug 2, 2026Updated 3 months ago
- [NeurIPS 2025] CamSAM2: Segment Anything Accurately in Camouflaged Videos☆21Nov 19, 2025Updated 11 months ago
- A parallel native tool caling deep search agentic framework with base window retention observation masking context management.☆25Sep 22, 2026Updated last month
- [CVPR 2025] Official Repository for the Paper: "Is this Generated Person Existed in Real-world? Fine-grained Detecting and Calibrating Ab…☆14Aug 25, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆17Oct 22, 2024Updated 2 years ago
- Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)☆35Mar 7, 2025Updated last year
- ☆14May 4, 2026Updated 6 months ago
- ☆20Nov 20, 2024Updated last year
- ☆45Apr 6, 2026Updated 7 months ago
- A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models☆77Feb 25, 2025Updated last year
- N/A☆19Aug 15, 2022Updated 4 years ago
Are these results useful?