GRAIN: Gradient-based Intra-attention Pruning on Pre-trained Language Models
☆19Jul 12, 2023Updated 3 years ago
Alternatives and similar repositories for GRAIN
Users that are interested in GRAIN are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆23Nov 26, 2024Updated last year
- A PyTorch-based model pruning toolkit for pre-trained language models☆390Aug 31, 2023Updated 2 years ago
- Source code for "SimCKP: Simple Contrastive Learning of Keyphrase Representations", Findings of EMNLP 2023☆12Jun 20, 2025Updated last year
- DiTAS: Quantizing Diffusion Transformers via Enhanced Activation Smoothing (WACV 2025)☆13Feb 7, 2026Updated 5 months ago
- ☆30Jul 22, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Official code of our work, Representation Learning for Resource-Constrained Keyphrase Generation.☆11May 26, 2022Updated 4 years ago
- ☆10Oct 28, 2024Updated last year
- This repositary hosts my experiments for the project, I did with OffNote Labs.☆10Apr 12, 2021Updated 5 years ago
- Post-Trained MoE Can Skip Half Experts via Self-Distillation☆38May 19, 2026Updated 2 months ago
- 利用BERT预训练模型进行文本生成，可用于对话、摘要、问题生成等任务。 目前支持策略，词表的插入和删除、自定义Character Embedding、随机词替换等☆10Jun 1, 2022Updated 4 years ago
- ☆13Jun 2, 2022Updated 4 years ago
- Extreme Multi-label Text Classification based on X-BERT with GCN and Clustering modules☆11Nov 10, 2019Updated 6 years ago
- An attempt to migrate Karpathy's llm.c to safe rust.☆13Jun 4, 2024Updated 2 years ago
- 利用大语言模型进行卧底游戏，包括谁是卧底及衍生的发现AI卧底游戏等。☆11Sep 6, 2024Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- 高质量闲聊数据介绍☆30Dec 12, 2018Updated 7 years ago
- ☆14Jan 10, 2024Updated 2 years ago
- 微信集赞，朋友圈集赞，支持多种集赞模式，快速生成1000赞。☆17Mar 4, 2023Updated 3 years ago
- ☆14Oct 21, 2020Updated 5 years ago
- Introduction to Rust - 构建 Rust 语言的完整知识体系☆22Jun 24, 2026Updated last month
- High-performance Machine Learning, Dynamic Auto-Differentiation and Tensor Algebra crate for Rust☆18Jun 8, 2025Updated last year
- Repository for the paper "Automating App Review Response Generation"☆11Nov 16, 2021Updated 4 years ago
- An implementation of the DISP-LLM method from the NeurIPS 2024 paper: Dimension-Independent Structural Pruning for Large Language Models.☆25Aug 6, 2025Updated 11 months ago
- Material for the course of "Mathematics of Transformer"☆23Aug 3, 2025Updated 11 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆15Jan 19, 2020Updated 6 years ago
- GOAT(山羊)是中英文大语言模型，基于LlaMa进行SFT。☆12Apr 24, 2023Updated 3 years ago
- nlp包括对话的数据集收集整理☆14Mar 8, 2020Updated 6 years ago
- Login Module for Administrator☆10Jul 11, 2016Updated 10 years ago
- ☆60Jun 10, 2024Updated 2 years ago
- Ansible playbook of MooseFS☆12Sep 18, 2013Updated 12 years ago
- Repo for the EMNLP'24 Paper "Dual-Space Knowledge Distillation for Large Language Models". A general white-box KD framework for both same…☆63Mar 21, 2026Updated 4 months ago
- 一些纪录☆11May 22, 2017Updated 9 years ago
- 对比学习 虾皮同款商品匹配☆17Jan 29, 2022Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 基于Bert的信息检索问答☆18Jun 19, 2020Updated 6 years ago
- Code for ACL 2019 paper "Enhancing Topic-to-Essay Generation with External Commonsense Knowledge "☆27Aug 13, 2019Updated 6 years ago
- An auto-reload module for python app.☆11Nov 12, 2014Updated 11 years ago
- VLE: Vision-Language Encoder (VLE: 视觉-语言多模态预训练模型)☆196Mar 13, 2023Updated 3 years ago
- Meta-BERT: Learning to Learn fast For Low-Resource Text Classification☆19Oct 22, 2021Updated 4 years ago
- Collect papers related to personalized text generation☆18Sep 6, 2021Updated 4 years ago
- [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…☆39Mar 11, 2024Updated 2 years ago