Alternatives and similar repositories for SciMT-benchmark:

Users that are interested in SciMT-benchmark are comparing it to the libraries listed below

• HICAI-ZJU / SciKnowEval
  SciKnowEval: Evaluating Multi-level Scientific Knowledge of Large Language Models
  ☆15Updated 5 months ago
• IDEA-XL / PRESTO
  PRESTO: Progressive Pretraining Enhances Synthetic Chemistry Outcomes [EMNLP 2024]
  ☆25Updated 4 months ago
• ylsung / vl-merging
  PyTorch codes for the paper "An Empirical Study of Multimodal Model Merging"
  ☆38Updated last year
• instance-wise-ordered-transformer / IOT
  ☆20Updated 4 years ago
• Alab-NII / Awesome-SciLM
  Pre-trained Language Model for Scientific Text
  ☆44Updated last year
• ozyyshr / StructChem
  Structured Chemistry Reasoning with Large Language Models
  ☆35Updated 10 months ago
• general-preference / general-preference-model
  Official implementation of paper "Beyond Bradley-Terry Models: A General Preference Model for Language Model Alignment" (https://arxiv.or…
  ☆22Updated last month
• RenzeLou / AAAR-1.0
  The source code for running LLMs on the AAAR-1.0 benchmark.
  ☆16Updated this week
• arnab-api / romba
  Applies ROME and MEMIT on Mamba-S4 models
  ☆14Updated 11 months ago
• facebookresearch / dualformer
  implementation of dualformer
  ☆13Updated last month
• Leezekun / MMSci
  MMSci: A Multimodal Multi-Discipline Dataset for PhD-Level Scientific Comprehension
  ☆40Updated 3 months ago
• zhenyuhe00 / BiPE
  Two Stones Hit One Bird: Bilevel Positional Encoding for Better Length Extrapolation, ICML 2024
  ☆22Updated 9 months ago
• QizhiPei / MathFusion
  MathFusion: Enhancing Mathematic Problem-solving of LLM through Instruction Fusion
  ☆16Updated last week
• IDEA-XL / InstructMol
  InstructMol: Multi-Modal Integration for Building a Versatile and Reliable Molecular Assistant in Drug Discovery (COLING 2025)
  ☆45Updated 3 months ago
• Ahren09 / AgentReview
  Official Implementation for EMNLP 2024 (main) "AgentReview: Exploring Academic Peer Review with LLM Agent."
  ☆49Updated 4 months ago
• FreedomIntelligence / PlatoLM
  A trainable user simulator
  ☆34Updated 6 months ago
• maszhongming / ParaKnowTransfer
  Code for "Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective"
  ☆32Updated 10 months ago
• zzwjames / FailureLLMUnlearning
  An official implementation of "Catastrophic Failure of LLM Unlearning via Quantization" (ICLR 2025)
  ☆26Updated last month
• GraphPKU / Case_or_Rule
  exploring whether LLMs perform case-based or rule-based reasoning
  ☆28Updated last year
• wzq016 / PINE
  Offcial Repo of Paper "Eliminating Position Bias of Language Models: A Mechanistic Approach""
  ☆13Updated 7 months ago
• lsh0520 / 3D-MoLM
  ☆43Updated 11 months ago
• guolinke / fused_ops
  ☆10Updated 2 years ago
• janphilippfranken / sami
  Self-Supervised Alignment with Mutual Information
  ☆16Updated 10 months ago
• RUCAIBox / RLMEC
  The official repository of "Improving Large Language Models via Fine-grained Reinforcement Learning with Minimum Editing Constraint"
  ☆37Updated last year
• Alsace08 / OOD-Math-Reasoning
  [NeurIPS 2024] Code and Data Repo for Paper "Embedding Trajectory for Out-of-Distribution Detection in Mathematical Reasoning"
  ☆24Updated 10 months ago
• dongxiangjue / Awesome-LLM-Self-Improvement
  A curated list of awesome LLM Inference-Time Self-Improvement (ITSI, pronounced "itsy") papers from our recent survey: A Survey on Large …
  ☆74Updated 3 months ago
• mathllm / Step-Controlled_DPO
  ☆21Updated 8 months ago
• yifeiwang77 / Self-Correction
  ☆20Updated 4 months ago
• OpenBMB / CPO
  ☆20Updated 8 months ago
• eltociear / MolCA
  Code for EMNLP2023 paper "MolCA: Molecular Graph-Language Modeling with Cross-Modal Projector and Uni-Modal Adapter".
  ☆12Updated last year