This repository presents the original implementation of Pretraining Data Detection for Large Language Models: A Divergence-based Calibration Method by Weichao Zhang, Ruqing Zhang, Jiafeng Guo, Maarten de Rijke, Yixing Fan, Xueqi Cheng
☆23May 21, 2025Updated last year
Alternatives and similar repositories for DC-PDD
Users that are interested in DC-PDD are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICLR'25 Spotlight] Min-K%++: Improved baseline for detecting pre-training data of LLMs☆61May 26, 2025Updated last year
- ☆24Oct 14, 2024Updated 2 years ago
- ☆19Dec 23, 2025Updated 9 months ago
- ☆18Nov 18, 2024Updated last year
- ☆24Aug 28, 2026Updated last month
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Implementation for ACL 2024 paper "Meta-Task Prompting Elicits Embeddings from Large Language Models"☆12Jul 25, 2024Updated 2 years ago
- 基于源代码的图融合的智能合约漏洞检测☆24Apr 23, 2024Updated 2 years ago
- The Code and Script of "David's Slingshot: A Strategic Coordination Framework of Small LLMs Matches Large LLMs in Data Synthesis"☆34Jun 13, 2025Updated last year
- NLPBench: Evaluating NLP-Related Problem-solving Ability in Large Language Models☆10Oct 27, 2023Updated 2 years ago
- Implementation of Gradient Information Optimization (GIO) for effective and scalable training data selection☆14Jun 22, 2023Updated 3 years ago
- https://arxiv.org/abs/2404.10917☆14Mar 18, 2025Updated last year
- ☆18Feb 20, 2024Updated 2 years ago
- Mini Model Daemon☆13Nov 9, 2024Updated last year
- Unofficial Pytorch implementation of the paper 'Categorical Reparameterization with Gumbel-Softmax' and 'The Concrete Distribution: A Con…☆11Apr 27, 2021Updated 5 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Code for the paper "Overconfidence is a Dangerous Thing: Mitigating Membership Inference Attacks by Enforcing Less Confident Prediction" …☆13Sep 6, 2023Updated 3 years ago
- ☆153Apr 16, 2024Updated 2 years ago
- Code for our EMNLP 2023 paper - Beneath the Surface: Unveiling Harmful Memes with Multimodal Reasoning Distilled from Large Language Mode…☆15May 5, 2024Updated 2 years ago
- Training a reward model for RLHF using RWKV.☆15Jun 5, 2023Updated 3 years ago
- Nano SGLang☆16Jul 21, 2025Updated last year
- Open source code for paper "EDITS: Modeling and Mitigating Data Bias for Graph Neural Networks".☆28Jul 8, 2022Updated 4 years ago
- 利用BERT预训练模型进行文本生成，可用于对话、摘要、问题生成等任务。 目前支持策略，词表的插入和删除、自定义Character Embedding、随机词替换等☆10Jun 1, 2022Updated 4 years ago
- ☆23Aug 7, 2023Updated 3 years ago
- Both Text and Images Leaked! A Systematic Analysis of Data Contamination in Multimodal LLM | EMNLP 2025 Findings☆18Oct 17, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- To mitigate position bias in LLMs, especially in long-context scenarios, we scale only one dimension of LLMs, reducing position bias and …☆13Jun 18, 2024Updated 2 years ago
- ☆16Aug 30, 2025Updated last year
- RWKV-7 mini☆12Mar 29, 2025Updated last year
- Open Source Version of florr.io☆10Jan 16, 2023Updated 3 years ago
- Direct Preference Optimization for RWKV, aiming for RWKV-5 and 6.☆11Mar 1, 2024Updated 2 years ago
- Audio-only Emotion Detection using Federated Learning☆10Dec 8, 2022Updated 3 years ago
- GoldFinch and other hybrid transformer components☆17Dec 9, 2025Updated 10 months ago
- Causal Reasoning for Membership Inference Attacks☆12Oct 21, 2022Updated 3 years ago
- ☆11Nov 17, 2024Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Shadow Attack, LiRA, Quantile Regression and RMIA implementations in PyTorch (Online version)☆14Nov 8, 2024Updated last year
- NaturalCodeBench (Findings of ACL 2024)☆71Oct 14, 2024Updated 2 years ago
- Self-Teaching Notes on Gradient Leakage Attacks against GPT-2 models.☆14Mar 18, 2024Updated 2 years ago
- Code for the paper "A Mechanistic Interpretation of Arithmetic Reasoning in Language Models using Causal Mediation Analysis"☆20Jun 12, 2025Updated last year
- 清华大学学生健康和出行情况报告每日自动提交☆14Jan 30, 2021Updated 5 years ago
- The official implementation of the paper "Data Contamination Calibration for Black-box LLMs" (ACL 2024)☆17May 21, 2024Updated 2 years ago
- Repository containing the website for the EMNLP 2023 conference☆17Feb 12, 2025Updated last year