yikee / ScienceMeterLinks
ScienceMeter: Tracking Scientific Knowledge Updates in Language Models
☆17Updated 6 months ago
Alternatives and similar repositories for ScienceMeter
Users that are interested in ScienceMeter are comparing it to the libraries listed below
Sorting:
- Resolving Knowledge Conflicts in Large Language Models, COLM 2024☆18Updated 2 months ago
- CopyBench: Measuring Literal and Non-Literal Reproduction of Copyright-Protected Text in Language Model Generation☆15Updated 4 months ago
- ☆16Updated last year
- The official repo for DARG: Dynamic Evaluation of Large Language Models via Adaptive Reasoning Graph☆18Updated last year
- ☆52Updated 8 months ago
- AbstainQA, ACL 2024☆28Updated last year
- ☆29Updated last year
- Are LLMs Capable of Data-based Statistical and Causal Reasoning? Benchmarking Advanced Quantitative Reasoning with Data☆44Updated 10 months ago
- Few-shot Learning with Auxiliary Data☆31Updated 2 years ago
- This repository contains data, code and models for contextual noncompliance.☆24Updated last year
- This is the official repository for HypoGeniC (Hypothesis Generation in Context) and HypoRefine, which are automated, data-driven tools t…☆97Updated last month
- Optimize Any User-defined Compound AI Systems☆65Updated 4 months ago
- [EMNLP 2024] A Peek into Token Bias: Large Language Models Are Not Yet Genuine Reasoners☆26Updated last year
- The Prism Alignment Project☆87Updated last year
- [EMNLP 2024] Official implementation of "Hierarchical Deconstruction of LLM Reasoning: A Graph-Based Framework for Analyzing Knowledge Ut…☆23Updated last year
- PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)☆41Updated last year
- [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering☆68Updated last year
- [ACL 2024] <Large Language Models for Automated Open-domain Scientific Hypotheses Discovery>. It has also received the best poster award …☆42Updated last year
- ☆28Updated 10 months ago
- ☆50Updated last year
- Stanford NLP Python library for benchmarking the utility of LLM interpretability methods☆161Updated 6 months ago
- [NeurIPS 2024] Knowledge Circuits in Pretrained Transformers☆161Updated last month
- The source code for running LLMs on the AAAR-1.0 benchmark.☆17Updated 8 months ago
- ☆165Updated last year
- ☆75Updated last year
- Exploring the Limitations of Large Language Models on Multi-Hop Queries☆29Updated 9 months ago
- Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.☆47Updated 9 months ago
- STREET: a multi-task and multi-step reasoning dataset☆24Updated last year
- [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs☆93Updated last year
- Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (EMNLP'2024)☆37Updated last year