HICAI-ZJU / SciKnowEval
SciKnowEval: Evaluating Multi-level Scientific Knowledge of Large Language Models
☆15Updated 3 months ago
Alternatives and similar repositories for SciKnowEval:
Users that are interested in SciKnowEval are comparing it to the libraries listed below
- ☆11Updated last year
- Structured Chemistry Reasoning with Large Language Models☆32Updated 9 months ago
- MMSci: A Multimodal Multi-Discipline Dataset for PhD-Level Scientific Comprehension☆39Updated 2 months ago
- Pre-trained Language Model for Scientific Text☆44Updated last year
- A trainable user simulator☆34Updated 5 months ago
- LLM for Scientific Research Survey☆50Updated 3 weeks ago
- BioT5 (EMNLP 2023) and BioT5+ (ACL 2024 Findings)☆103Updated 5 months ago
- Source code for "A Deep-learning System Bridging Molecule Structure and Biomedical Text with Comprehension Comparable to Human Profession…☆84Updated last year
- SciGLM: Training Scientific Language Models with Self-Reflective Instruction Annotation and Tuning (NeurIPS D&B Track 2024)☆78Updated 11 months ago
- What can Large Language Models do in chemistry? A comprehensive benchmark on eight tasks☆137Updated 6 months ago
- Must-read papers on NLP for science.☆58Updated last year
- Official implementation of paper "Beyond Bradley-Terry Models: A General Preference Model for Language Model Alignment" (https://arxiv.or…☆21Updated this week
- Official Repository of Are Your LLMs Capable of Stable Reasoning?☆18Updated this week
- ☆49Updated 8 months ago
- [ICLR 2025] <MOOSE-Chem: Large Language Models for Rediscovering Unseen Chemistry Scientific Hypotheses>☆25Updated last month
- A curated list of awesome LLM Inference-Time Self-Improvement (ITSI, pronounced "itsy") papers from our recent survey: A Survey on Large …☆67Updated last month
- [ACL 2024] <Large Language Models for Automated Open-domain Scientific Hypotheses Discovery>. It has also received the best poster award …☆38Updated 3 months ago
- [EMNLP 2023] ReLM: Leveraging Language Models for Enhanced Chemical Reaction Prediction.☆18Updated last year
- PRESTO: Progressive Pretraining Enhances Synthetic Chemistry Outcomes [EMNLP 2024]☆23Updated 3 months ago
- [EMNLP 2024] The official GitHub repo for the survey paper "Knowledge Conflicts for LLMs: A Survey"☆104Updated 5 months ago
- Code for EMNLP2023 paper "MolCA: Molecular Graph-Language Modeling with Cross-Modal Projector and Uni-Modal Adapter".☆12Updated last year
- Official code repo for the paper "LlaSMol: Advancing Large Language Models for Chemistry with a Large-Scale, Comprehensive, High-Quality …☆76Updated 3 months ago
- Official Implementation of the Baby-AIGS system☆22Updated 2 months ago
- SciAssess is a comprehensive benchmark for evaluating Large Language Models' proficiency in scientific literature analysis across various…☆70Updated 4 months ago
- InstructMol: Multi-Modal Integration for Building a Versatile and Reliable Molecular Assistant in Drug Discovery (COLING 2025)☆43Updated 2 months ago
- This repository contains information on the creation, evaluation, and benchmark models for the L+M-24 Dataset. L+M-24 will be featured as…☆26Updated 3 weeks ago
- Code and data for the ACL2024 paper "InstructProtein: Aligning Human and Protein Language via Knowledge Instruction".☆15Updated 5 months ago
- exploring whether LLMs perform case-based or rule-based reasoning☆28Updated 11 months ago