Alternatives and similar repositories for SciMT-benchmark:

Users that are interested in SciMT-benchmark are comparing it to the libraries listed below

• HICAI-ZJU / SciKnowEval
  SciKnowEval: Evaluating Multi-level Scientific Knowledge of Large Language Models
  ☆17Updated 5 months ago
• ylsung / vl-merging
  PyTorch codes for the paper "An Empirical Study of Multimodal Model Merging"
  ☆38Updated last year
• IDEA-XL / PRESTO
  PRESTO: Progressive Pretraining Enhances Synthetic Chemistry Outcomes [EMNLP 2024]
  ☆25Updated 5 months ago
• RenzeLou / AAAR-1.0
  The source code for running LLMs on the AAAR-1.0 benchmark.
  ☆16Updated 3 weeks ago
• facebookresearch / dualformer
  implementation of dualformer
  ☆15Updated last month
• arnab-api / romba
  Applies ROME and MEMIT on Mamba-S4 models
  ☆14Updated last year
• ozyyshr / StructChem
  Structured Chemistry Reasoning with Large Language Models
  ☆37Updated 11 months ago
• FreedomIntelligence / PlatoLM
  A trainable user simulator
  ☆34Updated 7 months ago
• ctlllll / reward_collapse
  ☆27Updated last year
• Ahren09 / AgentReview
  Official Implementation for EMNLP 2024 (main) "AgentReview: Exploring Academic Peer Review with LLM Agent."
  ☆49Updated 5 months ago
• wzq016 / PINE
  Offcial Repo of Paper "Eliminating Position Bias of Language Models: A Mechanistic Approach""
  ☆14Updated 8 months ago
• Leezekun / MMSci
  MMSci: A Multimodal Multi-Discipline Dataset for PhD-Level Scientific Comprehension
  ☆43Updated 4 months ago
• Alab-NII / Awesome-SciLM
  Pre-trained Language Model for Scientific Text
  ☆45Updated last year
• Thinklab-SJTU / BiLAF
  Official implementation of Our NeurIPS 2024 Paper "Boundary Matters: A Bi-Level Active Finetuning Method"
  ☆11Updated 2 months ago
• general-preference / general-preference-model
  Official implementation of paper "Beyond Bradley-Terry Models: A General Preference Model for Language Model Alignment" (https://arxiv.or…
  ☆23Updated 2 months ago
• Alsace08 / OOD-Math-Reasoning
  [NeurIPS 2024] Code and Data Repo for Paper "Embedding Trajectory for Out-of-Distribution Detection in Mathematical Reasoning"
  ☆25Updated 10 months ago
• AgentForceTeamOfficial / UA2-Agent
  Official Implementation of UA^{2}-Agent and other baseline algorithms of "Towards Unified Alignment Between Agents, Humans, and Environme…
  ☆17Updated 5 months ago
• limenlp / safer-instruct
  This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"
  ☆17Updated last year
• VITA-Group / o1-planning
  On The Planning Abilities of OpenAI's o1 Models: Feasibility, Optimality, and Generalizability
  ☆38Updated 3 months ago
• hartvigsen-group / composable-interventions
  ☆28Updated 2 months ago
• ChnQ / TracingLLM
  ☆25Updated 11 months ago
• Wang-ML-Lab / multimodal-needle-in-a-haystack
  [NAACL 2025 Oral] Multimodal Needle in a Haystack (MMNeedle): Benchmarking Long-Context Capability of Multimodal Large Language Models
  ☆42Updated last month
• chenllliang / MMEvalPro
  [NAACL 2025] Source code for MMEvalPro, a more trustworthy and efficient benchmark for evaluating LMMs
  ☆24Updated 7 months ago
• wenhuchen / ML-Interview
  Preparing for ML Interviews.
  ☆11Updated last week
• maitrix-org / de-arena
  Official repository for Decentralized Arena via Collective LLM Intelligence
  ☆10Updated 6 months ago
• GraphPKU / Case_or_Rule
  exploring whether LLMs perform case-based or rule-based reasoning
  ☆28Updated last year
• uservan / ThinkPO
  ☆20Updated 2 months ago
• instance-wise-ordered-transformer / IOT
  ☆20Updated 4 years ago
• zhenyuhe00 / BiPE
  Two Stones Hit One Bird: Bilevel Positional Encoding for Better Length Extrapolation, ICML 2024
  ☆22Updated 10 months ago
• IDEA-XL / InstructMol
  InstructMol: Multi-Modal Integration for Building a Versatile and Reliable Molecular Assistant in Drug Discovery (COLING 2025)
  ☆47Updated 4 months ago