GRAIN: Gradient-based Intra-attention Pruning on Pre-trained Language Models
☆18Jul 12, 2023Updated 3 years ago
Alternatives and similar repositories for GRAIN
Users that are interested in GRAIN are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [NeurIPS 2024] Search for Efficient LLMs☆16Jan 16, 2025Updated last year
- MachGen's VC attention (https://arxiv.org/html/2609.15810v1) implementation. 2x faster (compared to 1.47-1.6x in original paper) FP8 atte…☆15Oct 12, 2026Updated 3 weeks ago
- A PyTorch-based model pruning toolkit for pre-trained language models☆391Aug 31, 2023Updated 3 years ago
- Source code for "SimCKP: Simple Contrastive Learning of Keyphrase Representations", Findings of EMNLP 2023☆11Jun 20, 2025Updated last year
- ☆23Nov 26, 2024Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- CREST is a training-free test-time steering framework that discovers cognitive heads via simple offline calibration and then rotates acti…☆12Oct 22, 2026Updated 2 weeks ago
- DiTAS: Quantizing Diffusion Transformers via Enhanced Activation Smoothing (WACV 2025)☆13Feb 7, 2026Updated 9 months ago
- Official code of our work, Representation Learning for Resource-Constrained Keyphrase Generation.☆11May 26, 2022Updated 4 years ago
- ☆30Jul 22, 2024Updated 2 years ago
- [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…☆31Mar 12, 2024Updated 2 years ago
- 模型量化工程 Base pretrained models and datasets in pytorch (MNIST, SVHN, CIFAR10, CIFAR100, STL10, AlexNet, VGG16, VGG19, ResNet, Inception,…☆12Aug 3, 2018Updated 8 years ago
- Radio Group implementation without the need for nested layout. To be mainly used with ConstraintLayout☆12Jun 25, 2019Updated 7 years ago
- [ICLR2026] Learnable Sparsity for Vision Generative Models☆14Mar 3, 2026Updated 8 months ago
- Post-Trained MoE Can Skip Half Experts via Self-Distillation☆42Sep 6, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 记录有用的Git repos☆12Jul 28, 2024Updated 2 years ago
- An implementation of <Group Fisher Pruning for Practical Network Compression> based on pytorch and mmcv☆18Nov 21, 2021Updated 4 years ago
- [NeurIPS 2023] Token-Scaled Logit Distillation for Ternary Weight Generative Language Models☆18Dec 6, 2023Updated 2 years ago
- ☆14Oct 21, 2020Updated 6 years ago
- GOAT(山羊)是中英文大语言模型，基于LlaMa进行SFT。☆12Apr 24, 2023Updated 3 years ago
- 양재 AI 실무자 교육 6조 프로젝트☆21Sep 18, 2018Updated 8 years ago
- Material for the course of "Mathematics of Transformer"☆24Aug 3, 2025Updated last year
- nlp包括对话的数据集收集整理☆14Mar 8, 2020Updated 6 years ago
- T5-base model for Korean☆27May 20, 2021Updated 5 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆64Oct 17, 2023Updated 3 years ago
- Code for ACL 2019 paper "Enhancing Topic-to-Essay Generation with External Commonsense Knowledge "☆27Aug 13, 2019Updated 7 years ago
- VLE: Vision-Language Encoder (VLE: 视觉-语言多模态预训练模型)☆196Mar 13, 2023Updated 3 years ago
- Seq2BF：based on paper《Sequence to Backward and Forward Sequences: A Content-Introducing Approach to Generative Short-Text Conversation》，C…☆17Nov 18, 2018Updated 7 years ago
- Part-of-speech tagger for the English language☆10Jul 31, 2018Updated 8 years ago
- SCI期刊信息爬虫☆14Jan 6, 2019Updated 7 years ago
- Sophon-Realtime v1: open full-duplex voice models that hear your tone and speak with one. Tag and Flash run on one GPU with vLLM-Omni; E2…☆21Updated this week
- [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…☆39Mar 11, 2024Updated 2 years ago
- ☆62Jun 10, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ICME2022 Special Session “Beyond Accuracy: Responsible, Responsive, and Robust Multimedia Retrieval ”☆12Jun 3, 2024Updated 2 years ago
- Repo for the EMNLP'24 Paper "Dual-Space Knowledge Distillation for Large Language Models". A general white-box KD framework for both same…☆66Mar 21, 2026Updated 7 months ago
- Source code and datasets for the CIKM 2020 paper "Knowledge-Enhanced Personalized Review Generation with Capsule Graph Neural Network".☆15Nov 20, 2020Updated 5 years ago
- Recent papers on Graph Neural Networks-based Recommender System.☆13Aug 21, 2023Updated 3 years ago
- [CVPR 2025] Q-DiT: Accurate Post-Training Quantization for Diffusion Transformers☆81Sep 3, 2024Updated 2 years ago
- Reinforcement Learning Environments for Omniverse Isaac Gym☆10May 9, 2023Updated 3 years ago
- Spell Checker in Python☆10Nov 11, 2013Updated 12 years ago
Are these results useful?