A unified evaluation toolkit and leaderboard for rigorously assessing the scientific intelligence of large language and vision–language models across the full research workflow.
☆87Aug 30, 2026Updated 3 weeks ago
Alternatives and similar repositories for SciEvalKit
Users that are interested in SciEvalKit are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Probing Scientific General Intelligence of LLMs with Scientist-Aligned Workflows☆171Jun 2, 2026Updated 3 months ago
- 🦞 ResearchClawBench: Evaluating AI Agents for Automated Research from Re-Discovery to New-Discovery☆264Updated this week
- The world’s first science-focused human-AI Agent collaborative discussion community.☆80Mar 6, 2026Updated 6 months ago
- ☆23Apr 11, 2026Updated 5 months ago
- Assessing Context-Aware Creative Intelligence in MLLMs☆23Jul 22, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- (ACL-2025 main conference) Dolphin: Moving Towards Closed-loop Auto-research through Thinking, Practice, and Feedback☆45Jun 24, 2025Updated last year
- EcoClaw: Save 90%+ on LLM Costs for OpenClaw with One Plugin☆29Apr 3, 2026Updated 5 months ago
- Official Repository: A Comprehensive Benchmark for Logical Reasoning in MLLMs☆45Jun 17, 2025Updated last year
- P1-VL: Bridging Visual Perception and Scientific Reasoning in Physics Olympiads☆14Feb 11, 2026Updated 7 months ago
- The official implementation of "ML-Agent: Reinforcing LLM Agents for Autonomous Machine Learning Engineering"☆74Jun 21, 2025Updated last year
- A curated collection of papers, datasets, and resources on Scientific Datasets and Large Language Models (LLMs)☆461Oct 3, 2025Updated 11 months ago
- An Agentic Data Preparation Framework for AGI-driven Scientific Discovery☆46Feb 11, 2026Updated 7 months ago
- Ultra-light Harness scaffolding for AI agents, a mini version of claude code☆962Jun 10, 2026Updated 3 months ago
- Official implementation for paper "How Far Are We from Genuinely Useful Deep Research Agents?"☆66Dec 10, 2025Updated 9 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- [ICML 2026] InnoEval: On Research Idea Evaluation as a Knowledge-Grounded, Multi-Perspective Reasoning Problem☆30Jun 21, 2026Updated 3 months ago
- A Massive-Scale Benchmark Dataset for Surface Wave Dispersion Curve Inversion☆19Nov 19, 2025Updated 10 months ago
- ☆45Mar 30, 2026Updated 5 months ago
- A Scientific Multimodal Foundation Model☆864Sep 13, 2026Updated last week
- ☆42Jun 4, 2026Updated 3 months ago
- Grand Challenge; autoPET 2022; MICCAI 2022 challenges☆15Sep 17, 2022Updated 4 years ago
- LMM for VQA, tcsvt version☆10Jul 19, 2024Updated 2 years ago
- Matlab code for the paper "Representing noisy image without denoising"☆10Jan 21, 2023Updated 3 years ago
- InternAgent-1.5: A Unified Agentic Framework for Long-Horizon Autonomous Scientific Discovery☆1,443Jul 29, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Archer: Agentic Code Review for LLVM PRs☆26Sep 8, 2026Updated 2 weeks ago
- ☆16Sep 4, 2025Updated last year
- [ECCV 2026] Official repository of "Reliable Reasoning in SVG-LLMs via Multi-Task Multi-Reward Reinforcement Learning".☆27Jul 17, 2026Updated 2 months ago
- An LLM-based fuzzing framework for C compilers testing.☆25Dec 14, 2025Updated 9 months ago
- U-VLM: Hierarchical Vision Language Modeling for Report Generation☆20Apr 30, 2026Updated 4 months ago
- ExtremeCast: Boosting Extreme Value Prediction for Global Weather Forecast☆28Mar 17, 2026Updated 6 months ago
- A curated guide for LLM-agent-driven scientific research automation — from getting started to the frontier.☆36Apr 21, 2026Updated 5 months ago
- Own eidetic-memory like Sheldon☆32Apr 8, 2026Updated 5 months ago
- A Unified Language Model to Integrate Biomedical Text with 2D and 3D Molecular Representations☆26Jul 19, 2024Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- A python script for downloading huggingface datasets and models.☆20Apr 10, 2025Updated last year
- ☆13Nov 5, 2024Updated last year
- The First Unified Agent Data Synthesis Framework for Custom Agentic Task with all-in-one envrionment☆140May 4, 2026Updated 4 months ago
- Medical Visual Question Answering via Conditional Reasoning [ACM MM 2020]☆64Aug 20, 2021Updated 5 years ago
- Some thoughts about writing scientific papers☆23Nov 8, 2024Updated last year
- Matlab code for the paper "Robust and discriminative image representation: Fractional-order Jacobi-Fourier Moments"☆17Feb 17, 2021Updated 5 years ago
- A Framework for Decoupling and Assessing the Capabilities of VLMs☆44Jun 28, 2024Updated 2 years ago