SciAssess is a comprehensive benchmark for evaluating Large Language Models' proficiency in scientific literature analysis across various fields, focusing on memorization, comprehension, and analysis.
☆83May 21, 2025Updated 10 months ago
Alternatives and similar repositories for SciAssess
Users that are interested in SciAssess are comparing it to the libraries listed below
Sorting:
- ☆52Oct 16, 2024Updated last year
- an efficient distributed PyTorch framework☆160Jul 19, 2025Updated 8 months ago
- [CVPR 25] MarkushGrapher: Joint Visual and Textual Recognition of Markush Structures☆38Oct 27, 2025Updated 4 months ago
- Implementation of paper "Uni-3DAR: Unified 3D Generation and Understanding via Autoregression on Compressed Spatial Tokens"☆145Apr 21, 2025Updated 11 months ago
- SciKnowEval: Evaluating Multi-level Scientific Knowledge of Large Language Models☆27Jul 13, 2025Updated 8 months ago
- ☆18Jul 25, 2025Updated 7 months ago
- [Nat. Commun.] PatCID: an open-access dataset of chemical structures in patent documents☆71Oct 27, 2025Updated 4 months ago
- This is the official code for MolReasoner: Toward Effective and Interpretable Reasoning for Molecular LLMs☆44Aug 28, 2025Updated 6 months ago
- Repository for the EMNLP 2023 Demo Paper "Reaction Miner: An Integrated System for Chemical Reaction Extraction from Textual Data"☆19Jan 27, 2025Updated last year
- ☆17Jul 17, 2025Updated 8 months ago
- MMSci: A Multimodal Multi-Discipline Dataset for PhD-Level Scientific Comprehension☆53Dec 3, 2024Updated last year
- ☆95Jul 11, 2024Updated last year
- Learnable Global Pooling Layers Based on Regularized Optimal Transport (ROT)☆16Mar 17, 2024Updated 2 years ago
- TED-GEN: a universal, efficient image generation framework for electron microscopy☆10May 7, 2025Updated 10 months ago
- Code release for "SPIQA: A Dataset for Multimodal Question Answering on Scientific Papers" [NeurIPS D&B, 2024]☆74Jan 13, 2025Updated last year
- [ICML 2025 Oral] This is the official repository of the paper "What Limits Virtual Agent Application? OmniBench: A Scalable Multi-Dimensi…☆22Jun 12, 2025Updated 9 months ago
- KeepGPU is a simple CLI app that keeps your GPUs running.☆27Mar 9, 2026Updated last week
- ☆14Apr 16, 2024Updated last year
- Official Repository for the Uni-Mol Series Methods☆1,080May 29, 2025Updated 9 months ago
- An evaluation suite for Retrieval-Augmented Generation (RAG).☆23Apr 26, 2025Updated 10 months ago
- This is an updated version of the MolecularTransformer of Schwaller et. al.☆14Jan 17, 2022Updated 4 years ago
- Docling Haystack integration☆28Jan 13, 2025Updated last year
- ☆18Mar 31, 2024Updated last year
- SciQAG is a novel framework for automatically generating high-quality science question-answer pairs from a large corpus of scientific lit…☆33Mar 24, 2025Updated 11 months ago
- A Sequence Generation Model for Reaction Diagram Parsing☆108Sep 18, 2023Updated 2 years ago
- [CIKM2024] The official implementation of "MMPolymer: A Multimodal Multitask Pretraining Framework for Polymer Property Prediction"☆39Aug 20, 2025Updated 7 months ago
- Fully automated end to end framework to extract data from complex charts and other figures in scientific literature.☆20Oct 30, 2022Updated 3 years ago
- ☆54Aug 26, 2025Updated 6 months ago
- ☆27Jul 23, 2025Updated 7 months ago
- 机器学习乐园：主要包括机器学习基础，深度学习实践，工业应用。☆15Nov 14, 2022Updated 3 years ago
- [JCheminfo] Ualign: pushing the limit of template-free retrosynthesis prediction with unsupervised SMILES alignment☆17Dec 26, 2024Updated last year
- The source code for "MG-BERT: Multi-Graph Augmented BERT for Masked Language Modeling" paper (NAACL 2021, TextGraphs-15).☆12Jun 11, 2021Updated 4 years ago
- A list of papers for group meeting☆19Mar 6, 2026Updated 2 weeks ago
- A Multi-modal System for Automated Mining of Protein-Ligand Bioactivity Data from Literature☆72Mar 5, 2026Updated 2 weeks ago
- Multimodal Pretraining for Unsupervised Protein Representation Learning☆22Jul 30, 2024Updated last year
- RACE is a multi-dimensional benchmark for code generation that focuses on Readability, mAintainability, Correctness, and Efficiency.☆12Oct 12, 2024Updated last year
- TAT-DQA: Towards Complex Document Understanding By Discrete Reasoning☆23Sep 17, 2024Updated last year
- Official code repository of < CBGBench: Fill in the Blank of Protein-Molecule Complex Binding Graph >☆324Sep 14, 2025Updated 6 months ago
- Repository for ACL paper: "Statements: Universal Information Extraction from Tables with Large Language Models for ESG KPIs"☆17Jul 1, 2024Updated last year