Official PyTorch implementation of DistiLLM-2: A Contrastive Approach Boosts the Distillation of LLMs (ICML 2025 Oral)
☆58Jun 27, 2025Updated 8 months ago
Alternatives and similar repositories for distillm-2
Users that are interested in distillm-2 are comparing it to the libraries listed below
Sorting:
- This repo is for CaesarNeRF: Calibrated Semantic Representation for Few-Shot Generalizable Neural Rendering.☆14Mar 6, 2024Updated last year
- LongAttn ：Selecting Long-context Training Data via Token-level Attention☆15Jul 16, 2025Updated 7 months ago
- (ICLR 2025) Multi-Task Corrupted Prediction for Learning Robust Audio-Visual Speech Representation☆15Apr 29, 2025Updated 10 months ago
- Official PyTorch implementation of DistiLLM: Towards Streamlined Distillation for Large Language Models (ICML 2024)☆251Mar 13, 2025Updated 11 months ago
- Research work aimed at addressing the problem of modeling infinite-length context☆46Dec 18, 2025Updated 2 months ago
- The first spoken long-text dataset derived from live streams, designed to reflect the redundancy-rich and conversational nature of real-w…☆12Jun 28, 2025Updated 8 months ago
- ☆43Aug 15, 2025Updated 6 months ago
- [ICLR 2025] MiniPLM: Knowledge Distillation for Pre-Training Language Models☆73Nov 23, 2024Updated last year
- Awesome LLM papers, news and projects about learning to reason with LLM, OpenAI o1, reasonning techniques, chain-of-thought (COT), Large …☆27Oct 10, 2024Updated last year
- implementation of Relation Classification via Convolutional Deep Neural Network☆29Mar 31, 2018Updated 7 years ago
- ☆13Dec 13, 2024Updated last year
- ☆28Feb 24, 2026Updated last week
- (NeurIPS 2022) Understanding Cross-Domain Few-Shot Learning Based on Domain Similarity and Few-Shot Difficulty☆33Mar 19, 2024Updated last year
- Moments Retrieval Project Webpage (temporal)☆31Jan 17, 2024Updated 2 years ago
- Pytorch implementation of our paper MaxQ: Multi-Axis Query for N:M Sparsity Network accepted by CVPR 2024.☆37Mar 12, 2024Updated last year
- Official PyTorch implementation of SynergyNeRF: "Synergistic Integration of Coordinate Network and Tensorial Feature for Improving NeRFs …☆10Sep 23, 2024Updated last year
- Towards Memorization-Free Diffusion Models (CVPR2024) Codebase☆12Jun 2, 2024Updated last year
- ☆10Nov 17, 2022Updated 3 years ago
- ECG analysis to classify anterior myocardial infarction cases.☆10May 17, 2017Updated 8 years ago
- ☆11Aug 20, 2025Updated 6 months ago
- UnitEval is a benchmarking and evaluation tools for AutoDev Coder.☆13Jan 2, 2024Updated 2 years ago
- Code for reproducing our paper: LMSOC: An Approach for Socially Sensitive Pretraining☆13Oct 22, 2021Updated 4 years ago
- ☆38Feb 20, 2026Updated last week
- Dataset for the paper "HVAQ: A High-Resolution Vision-Based Air Quality Dataset"☆10Nov 20, 2021Updated 4 years ago
- Exploring how optimizations for GEMMs work☆28Jan 1, 2026Updated 2 months ago
- An interactive Rust learning platform featuring progressive exercises aligned with "The Rust Programming Language" book.☆20Dec 8, 2025Updated 2 months ago
- EMNLP 2022: Analyzing and Evaluating Faithfulness in Dialogue Summarization☆13Mar 20, 2025Updated 11 months ago
- This repository contains code used for our Multi Sentence Inference NAACL'22 paper.☆12Mar 6, 2023Updated 2 years ago
- Exploring Robustness of Unsupervised Domain Adaptation in Semantic Segmentation (ICCV 2021; Oral)☆12Oct 9, 2022Updated 3 years ago
- 本项目提供了面向中文的XLNet预训练模型，旨在丰富中文自然语言处理资源，提供多元化的中文预训练模型选择。 我们欢迎各位专家学者下载使用，并共同促进和发展中文资源建设。☆11May 30, 2023Updated 2 years ago
- ☆14Jan 24, 2025Updated last year
- ☆13May 21, 2023Updated 2 years ago
- ☆26Oct 16, 2025Updated 4 months ago
- Official implementation of Hierarchical Context Merging: Better Long Context Understanding for Pre-trained LLMs (ICLR 2024).☆44Aug 6, 2024Updated last year
- Code Implementation, Evaluations, Documentation, Links and Resources for Min P paper☆47Aug 13, 2025Updated 6 months ago
- A Mixed Sample Data Augmentation method for Training with Time-Frequency Domain Features☆10Oct 5, 2022Updated 3 years ago
- Bidirectional Likelihood Estimation with Multi-Modal Large Language Models for Text-Video Retrieval (ICCV 2025 Highlight)☆20Aug 1, 2025Updated 7 months ago
- The codes for ECCV'22: Learning to Train a Point Cloud Reconstruction Network without Matching☆10Nov 16, 2022Updated 3 years ago
- Contrastive self-supervised learning using Rényi divergence☆14Oct 21, 2022Updated 3 years ago