A unified evaluation toolkit and leaderboard for rigorously assessing the scientific intelligence of large language and vision–language models across the full research workflow.
☆87Aug 30, 2026Updated 2 months ago
Alternatives and similar repositories for SciEvalKit
Users that are interested in SciEvalKit are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Probing Scientific General Intelligence of LLMs with Scientist-Aligned Workflows☆172Jun 2, 2026Updated 5 months ago
- The official repository of Omni-Weather. Code will be made publicly available soon.☆17Mar 30, 2026Updated 7 months ago
- ☆93Dec 26, 2025Updated 10 months ago
- A lightweight, general-purpose harness for tool-using LLM agents, fair benchmark evaluation, harness baselines, and personal assistant wo…☆51Jul 16, 2026Updated 3 months ago
- [ACL 2025] Redundancy Principles for MLLMs Benchmarks☆10Aug 20, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Assessing Context-Aware Creative Intelligence in MLLMs☆23Jul 22, 2025Updated last year
- The first high school physics Olympiad benchmark for evaluating (M)LLMs with step-level grading and human-level comparison.☆26Dec 19, 2025Updated 10 months ago
- (ACL-2025 main conference) Dolphin: Moving Towards Closed-loop Auto-research through Thinking, Practice, and Feedback☆46Jun 24, 2025Updated last year
- ☆25Jul 10, 2026Updated 3 months ago
- Official GitHub repo for Scaling Physical Reasoning with the PHYSICS Dataset (NeurIPS25).☆17Sep 20, 2025Updated last year
- Official Repository: A Comprehensive Benchmark for Logical Reasoning in MLLMs☆45Jun 17, 2025Updated last year
- ExtremeCast: Boosting Extreme Value Prediction for Global Weather Forecast☆28Mar 17, 2026Updated 7 months ago
- A curated collection of papers, datasets, and resources on Scientific Datasets and Large Language Models (LLMs)☆460Oct 3, 2025Updated last year
- [ICLR 2026] CMPhysBench: A Benchmark for Evaluating Large Language Models in Condensed Matter Physics☆29Nov 1, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆21Nov 27, 2025Updated 11 months ago
- (ICCV-2025 Official Code)) Improving Generalist Model with Domain-Specific Experts☆87Oct 29, 2025Updated last year
- GMAI-MMBench: A Comprehensive Multimodal Evaluation Benchmark Towards General Medical AI.☆87Dec 17, 2024Updated last year
- P1-VL: Bridging Visual Perception and Scientific Reasoning in Physics Olympiads☆15Feb 11, 2026Updated 8 months ago
- Ultra-light Harness scaffolding for AI agents, a mini version of claude code☆973Jun 10, 2026Updated 4 months ago
- ☆16Apr 18, 2025Updated last year
- A python script for downloading huggingface datasets and models.☆20Apr 10, 2025Updated last year
- The official implementation of "ML-Agent: Reinforcing LLM Agents for Autonomous Machine Learning Engineering"☆77Jun 21, 2025Updated last year
- This is our repository for the training code on the DeepResearch-9K dataset.☆14Apr 21, 2026Updated 6 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Official Repository of ACL 2025 paper OmniAlign-V: Towards Enhanced Alignment of MLLMs with Human Preference☆144Apr 2, 2026Updated 7 months ago
- A Scientific Multimodal Foundation Model☆871Sep 13, 2026Updated last month
- ☆45Mar 30, 2026Updated 7 months ago
- ☆17Sep 16, 2026Updated last month
- 赛博苏神：你的 research 好老师☆15Jun 16, 2026Updated 4 months ago
- Exploring Representation-Aligned Latent Space for Better Generation☆19Mar 17, 2026Updated 7 months ago
- LMM for VQA, tcsvt version☆10Jul 19, 2024Updated 2 years ago
- ☆45Jun 4, 2026Updated 5 months ago
- ☆16Sep 4, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆14Dec 5, 2025Updated 10 months ago
- [MICCAI 2026] A longitudinal, multimodal algorithm for multi-tumor segmentation (learning from reports).☆19Sep 24, 2026Updated last month
- Grand Challenge; autoPET 2022; MICCAI 2022 challenges☆15Sep 17, 2022Updated 4 years ago
- Official GitHub repo for SCI-Verifier: Scientific Verifier with Thinking (ICLR2026).☆11Jan 26, 2026Updated 9 months ago
- [MICCAI 2026] MedPruner: Training-Free Hierarchical Token Pruning for Efficient 3D Medical Image Understanding in Vision-Language Models☆12Jun 14, 2026Updated 4 months ago
- MacOS打印不求人☆21Aug 6, 2026Updated 2 months ago
- Archer: Agentic Code Review for LLVM PRs☆30Oct 23, 2026Updated last week