[ICLR 2025 Oral] Knowledge Entropy Decay during Language Model Pretraining Hinders New Knowledge Acquisition
☆17Nov 25, 2024Updated last year
Alternatives and similar repositories for Knowledge-Entropy
Users that are interested in Knowledge-Entropy are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆26Dec 12, 2025Updated 9 months ago
- All-in-one repository for Fine-tuning & Pretraining (Large) Language Models☆15Mar 8, 2023Updated 3 years ago
- IntructIR, a novel benchmark specifically designed to evaluate the instruction following ability in information retrieval models. Our foc…☆32Jun 13, 2024Updated 2 years ago
- [ACL 2023] Gradient Ascent Post-training Enhances Language Model Generalization☆29Sep 12, 2024Updated 2 years ago
- ☆16Oct 6, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆18Feb 4, 2026Updated 8 months ago
- [LREC-Coling 2024] PECC: Problem Extraction and Coding Challenges☆14May 30, 2024Updated 2 years ago
- Code base for LLM Unlearning via Neural Activation Redirection (NeurIPS 2025).☆21Nov 19, 2025Updated 10 months ago
- [COLING 2022] Mind the Gap! Injecting Commonsense Knowledge for Abstractive Dialogue Summarization☆25Mar 28, 2024Updated 2 years ago
- [ECCV 2024] Official implementation of "Uncertainty Calibration with Energy Based Instance-wise Scaling in the Wild Dataset"☆11Aug 13, 2024Updated 2 years ago
- [NeurIPS 2025] Reasoning Models Better Express Their Confidence"☆23Nov 19, 2025Updated 10 months ago
- PyTorch implementation of Pseudo-Riemannian Graph Convolutional Networks (NeurIPS'22))☆19Jul 5, 2024Updated 2 years ago
- Keep Me Updated! Memory Management in Long-term Conversations (Findings of EMNLP 2022)☆31Dec 2, 2022Updated 3 years ago
- ☆27May 14, 2026Updated 4 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆13Aug 12, 2026Updated last month
- The official repository of NeurIPS'25 paper "Ada-R1: From Long-Cot to Hybrid-CoT via Bi-Level Adaptive Reasoning Optimization"☆25May 6, 2026Updated 5 months ago
- PyTorch code for "FactPEGASUS: Factuality-Aware Pre-training and Fine-tuning for Abstractive Summarization" (NAACL 2022)☆40Sep 15, 2022Updated 4 years ago
- Repository for "Scaling Evaluation-time Compute with Reasoning Models as Process Evaluators"☆12Mar 25, 2025Updated last year
- It shows how to deploy and use an agent with LLM.☆19Mar 1, 2025Updated last year
- Code and Dataset release of "Carpe Diem: On the Evaluation of World Knowledge in Lifelong Language Models" (NAACL 2024)☆10Oct 16, 2024Updated last year
- Codebase for the work “Why Does Self-Distillation (Sometimes) Degrade the Reasoning Capability of LLMs?”☆77Apr 14, 2026Updated 5 months ago
- implementing Weight Agnostic Neural Networks to Spiking Neural Networks☆10Jan 26, 2021Updated 5 years ago
- code for EMNLP 2024 paper: Interpreting Arithmetic Mechanism in Large Language Models through Comparative Neuron Analysis☆12Nov 17, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- 2019 PyCon kr tutorial: "네이버 영화 평점 데이터로 자연어처리 논문 구현 시작하기"☆13Aug 21, 2019Updated 7 years ago
- ☆23Mar 20, 2024Updated 2 years ago
- 나와 똑 닮은 슈스 개발자 찾기 심리테스트☆13Nov 24, 2021Updated 4 years ago
- 👀 Write your post here, and see how it'll look on Instagram - Simple Web Editor using React & Recoil with State Persistence☆11Nov 6, 2020Updated 5 years ago
- Official code for the paper "Compositional Generalization Requires Linear, Orthogonal Representations in Vision Embedding Models"☆24Mar 7, 2026Updated 7 months ago
- Official Implementation of "OVS Meets Continual Learning: Towards Sustainable Open-Vocabulary Segmentation" (NeurIPS 2025).☆16Feb 27, 2026Updated 7 months ago
- Code for our paper titled "Lens: Rethinking Multilingual Enhancement for Large Language Models"☆12Oct 15, 2024Updated last year
- [NeurIPS2024] Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging☆143Mar 17, 2025Updated last year
- [EMNLP-2025] R1-Zero on ANY TASK☆33Nov 9, 2025Updated 11 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- 👀 대한민국 전자출입명부(QR 체크인)에 사용 되는 QR 코드 이미지를 가져오는 모듈 / Programmatically generate QR code image used in South Korea's COVID-19 pathway check-in☆10Oct 20, 2020Updated 5 years ago
- code for EMNLP 2024 paper: Neuron-Level Knowledge Attribution in Large Language Models☆52Nov 17, 2024Updated last year
- KoBART chatbot☆45Jun 22, 2021Updated 5 years ago
- [NeurIPS 2024 poster] Cross-model Control: Improving Multiple Large Language Models in One-time Training☆15Oct 25, 2024Updated last year
- ☆14Sep 17, 2025Updated last year
- [AAAI 2024] Investigating the Effectiveness of Task-Agnostic Prefix Prompt for Instruction Following☆79Sep 13, 2024Updated 2 years ago
- Russian Drug Reaction Corpus (RuDReC)☆13Dec 29, 2020Updated 5 years ago