Building modular LMs with parameter-efficient fine-tuning.
☆116Aug 26, 2026Updated this week
Alternatives and similar repositories for mttl
Users that are interested in mttl are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆54May 8, 2023Updated 3 years ago
- Codebase for Hyperdecoders https://arxiv.org/abs/2203.08304☆14Oct 11, 2022Updated 3 years ago
- ☆30Sep 28, 2023Updated 2 years ago
- Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"☆93Feb 27, 2024Updated 2 years ago
- One Network, Many Masks: Towards More Parameter-Efficient Transfer Learning☆40Jul 1, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆131Aug 18, 2022Updated 4 years ago
- ☆26Nov 23, 2023Updated 2 years ago
- ☆11Nov 13, 2024Updated last year
- ☆221Feb 3, 2024Updated 2 years ago
- ☆279Oct 31, 2023Updated 2 years ago
- [ACL 2023]: Training Trajectories of Language Models Across Scales https://arxiv.org/pdf/2212.09803.pdf☆25Nov 14, 2023Updated 2 years ago
- Official implementation for "Parameter-Efficient Fine-Tuning Design Spaces"☆27Jan 4, 2023Updated 3 years ago
- A flexible framework for running experiments with PyTorch models in a simulated Federated Learning (FL) environment.☆15Aug 11, 2023Updated 3 years ago
- ☆16Dec 11, 2025Updated 8 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- AutoPEFT: Automatic Configuration Search for Parameter-Efficient Fine-Tuning (Zhou et al.; TACL 2024)☆51Mar 17, 2024Updated 2 years ago
- [ICLR2023] NTK-SAP: Improving neural network pruning by aligning training dynamics☆20May 1, 2023Updated 3 years ago
- Codebase used in the paper "Foundational Models for Continual Learning: An Empirical Study of Latent Replay".☆29Jan 24, 2023Updated 3 years ago
- An official implementation for the EMNLP 2023 Findings paper "Prompt-Based Editing for Text Style Transfer"☆13Dec 9, 2023Updated 2 years ago
- DiWA: Diverse Weight Averaging for Out-of-Distribution Generalization☆31Jan 31, 2023Updated 3 years ago
- ☆79Apr 29, 2024Updated 2 years ago
- ☆15Jul 15, 2023Updated 3 years ago
- [CoRL22] Motion Style Transfer: Modular Low-Rank Adaptation for Deep Motion Forecasting☆22Dec 6, 2022Updated 3 years ago
- A Shared Nearest Neighbors clustering implementation. This code is basically a wrapper of sklearn DBSCAN, implementing the neighborhood s…☆16Jan 10, 2022Updated 4 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆21Oct 6, 2023Updated 2 years ago
- git extension for {collaborative, communal, continual} model development☆220Nov 14, 2024Updated last year
- ☆22Sep 19, 2023Updated 2 years ago
- Code Repository for the NeurIPS 2021 paper: "Self-Supervised Representation Learning on Neural Network Weights for Model Characteristic P…☆22Jul 10, 2024Updated 2 years ago
- An unofficial implementation of "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"☆35Jun 7, 2024Updated 2 years ago
- [ICML2023] Instant Soup Cheap Pruning Ensembles in A Single Pass Can Draw Lottery Tickets from Large Models. Ajay Jaiswal, Shiwei Liu, Ti…☆11Nov 28, 2023Updated 2 years ago
- Residual Prompt Tuning: a method for faster and better prompt tuning.☆56May 10, 2023Updated 3 years ago
- Code for NeurIPS 2024 paper: "Noether's razor: Learning Conserved Quantities" by Tycho F. A. van der Ouderaa, Mark van der Wilk, Pim de H…☆11Oct 12, 2024Updated last year
- Neural embeddings with negative sampling in Keras☆11Jun 11, 2017Updated 9 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- The official implementation of InterBERT☆11Oct 18, 2022Updated 3 years ago
- Spherical Merge Pytorch/HF format Language Models with minimal feature loss.☆153Sep 10, 2023Updated 2 years ago
- Repo for "Smart Word Suggestions" (SWS) task and benchmark☆20Dec 4, 2023Updated 2 years ago
- On the Effectiveness of Parameter-Efficient Fine-Tuning☆39Nov 4, 2023Updated 2 years ago
- This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…☆31Aug 25, 2023Updated 3 years ago
- Official code for the paper "Attention as a Hypernetwork"☆59Feb 24, 2026Updated 6 months ago
- ModuleFormer is a MoE-based architecture that includes two different types of experts: stick-breaking attention heads and feedforward exp…☆225Sep 18, 2025Updated 11 months ago