GRAIN: Gradient-based Intra-attention Pruning on Pre-trained Language Models
☆18Jul 12, 2023Updated 3 years ago
Alternatives and similar repositories for GRAIN
Users that are interested in GRAIN are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [NeurIPS 2024] Search for Efficient LLMs☆16Jan 16, 2025Updated last year
- ☆23Nov 26, 2024Updated last year
- A PyTorch-based model pruning toolkit for pre-trained language models☆390Aug 31, 2023Updated 3 years ago
- Source code for "SimCKP: Simple Contrastive Learning of Keyphrase Representations", Findings of EMNLP 2023☆12Jun 20, 2025Updated last year
- ☆12Oct 9, 2023Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- DiTAS: Quantizing Diffusion Transformers via Enhanced Activation Smoothing (WACV 2025)☆13Feb 7, 2026Updated 7 months ago
- ConstraintRadioGroup☆11Sep 16, 2020Updated 5 years ago
- ☆30Jul 22, 2024Updated 2 years ago
- Official code of our work, Representation Learning for Resource-Constrained Keyphrase Generation.☆11May 26, 2022Updated 4 years ago
- ☆10Oct 28, 2024Updated last year
- 蔡徐坤大战篮球小游戏☆11Mar 11, 2024Updated 2 years ago
- This repositary hosts my experiments for the project, I did with OffNote Labs.☆10Apr 12, 2021Updated 5 years ago
- Post-Trained MoE Can Skip Half Experts via Self-Distillation☆40Updated this week
- The implementation of Text Classification with Negative Supervision (ACL, 2020)☆10Oct 8, 2020Updated 5 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- 利用BERT预训练模型进行文本生成，可用于对话、摘要、问题生成等任务。 目前支持策略，词表的插入和删除、自定义Character Embedding、随机词替换等☆10Jun 1, 2022Updated 4 years ago
- ☆13Jun 2, 2022Updated 4 years ago
- 记录有用的Git repos☆12Jul 28, 2024Updated 2 years ago
- Code for CascadeBERT, Findings of EMNLP 2021☆12Mar 30, 2022Updated 4 years ago
- Extreme Multi-label Text Classification based on X-BERT with GCN and Clustering modules☆11Nov 10, 2019Updated 6 years ago
- An implementation of <Group Fisher Pruning for Practical Network Compression> based on pytorch and mmcv☆18Nov 21, 2021Updated 4 years ago
- ☆13Sep 6, 2022Updated 4 years ago
- 高质量闲聊数据介绍☆29Dec 12, 2018Updated 7 years ago
- ☆14Jan 10, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Implementation of paper "Transferring Robustness for Graph Neural Network Against Poisoning Attacks".☆20Feb 26, 2020Updated 6 years ago
- An implementation of the DISP-LLM method from the NeurIPS 2024 paper: Dimension-Independent Structural Pruning for Large Language Models.☆25Aug 6, 2025Updated last year
- Material for the course of "Mathematics of Transformer"☆24Aug 3, 2025Updated last year
- ☆15Jan 19, 2020Updated 6 years ago
- GOAT(山羊)是中英文大语言模型，基于LlaMa进行SFT。☆12Apr 24, 2023Updated 3 years ago
- Repo for the EMNLP'24 Paper "Dual-Space Knowledge Distillation for Large Language Models". A general white-box KD framework for both same…☆65Mar 21, 2026Updated 5 months ago
- 对比学习 虾皮同款商品匹配☆17Jan 29, 2022Updated 4 years ago
- Code for ACL 2019 paper "Enhancing Topic-to-Essay Generation with External Commonsense Knowledge "☆27Aug 13, 2019Updated 7 years ago
- 基于Bert的信息检索问答☆18Jun 19, 2020Updated 6 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- VLE: Vision-Language Encoder (VLE: 视觉-语言多模态预训练模型)☆196Mar 13, 2023Updated 3 years ago
- Meta-BERT: Learning to Learn fast For Low-Resource Text Classification☆19Oct 22, 2021Updated 4 years ago
- Collect papers related to personalized text generation☆18Sep 6, 2021Updated 5 years ago
- SCI期刊信息爬虫☆14Jan 6, 2019Updated 7 years ago
- T5-base model for Korean☆27May 20, 2021Updated 5 years ago
- Code for "Visual Spatial Description: Controlled Spatial-Oriented Image-to-Text Generation"☆25Mar 9, 2024Updated 2 years ago
- Part-of-speech tagger for the English language☆10Jul 31, 2018Updated 8 years ago