Code repository for the public reproduction of the language modelling experiments on "MatFormer: Nested Transformer for Elastic Inference"
☆32Nov 14, 2023Updated 3 years ago
Alternatives and similar repositories for MatFormer-OLMo
Users that are interested in MatFormer-OLMo are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- GoldFinch and other hybrid transformer components☆47Jul 20, 2024Updated 2 years ago
- An implementation of LazyLLM token pruning for LLaMa 2 model family.☆13Jan 6, 2025Updated last year
- [ACL 2023 Findings] Emergent Modularity in Pre-trained Transformers☆26Jun 7, 2023Updated 3 years ago
- Machine Learning Experiment Tracker and Sweep Manager☆19Updated this week
- Code repository for the paper - "Neural Priming for Sample-Efficient Adaptation"☆15Nov 13, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆21Oct 4, 2026Updated last month
- OpenBA-V2: 3B LLM (Large Language Model) with T5 architecture, utilizing model pruning technique and continuing pretraining from OpenBA-1…☆25May 10, 2024Updated 2 years ago
- The official Languini Kitchen repository☆14May 6, 2024Updated 2 years ago
- ☆14May 21, 2023Updated 3 years ago
- ☆14Nov 2, 2025Updated last year
- Beyond KV Caching: Shared Attention for Efficient LLMs☆20Jul 19, 2024Updated 2 years ago
- A tiny FP8 multiplication unit written in Verilog. TinyTapeout 2 submission.☆14Nov 23, 2022Updated 3 years ago
- Pile Deduplication Code☆18May 15, 2023Updated 3 years ago
- ☆41Apr 30, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Explorations into the recently proposed Taylor Series Linear Attention☆102Aug 27, 2026Updated 2 months ago
- Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model☆45Oct 1, 2025Updated last year
- Code for "Are “Hierarchical” Visual Representations Hierarchical?" in NeurIPS Workshop for Symmetry and Geometry in Neural Representation…☆23Nov 8, 2023Updated 3 years ago
- Submission to the inverse scaling prize☆23Jul 23, 2023Updated 3 years ago
- An experiment with modern C++, suffix trees, and Ukkonen's algorithm for suffix tree construction.☆12Mar 15, 2019Updated 7 years ago
- [NeurIPS 2024] The official implementation of "Kangaroo: Lossless Self-Speculative Decoding for Accelerating LLMs via Double Early Exitin…☆74Jun 26, 2024Updated 2 years ago
- a WIP architecture designed to allow transformers to think in a manner without tokens☆19Apr 12, 2024Updated 2 years ago
- JPEG Encoder for Cortex-M☆14Sep 2, 2016Updated 10 years ago
- Cascade Speculative Drafting☆32Apr 2, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆23Sep 1, 2026Updated 2 months ago
- [TIP] Exploring Effective Factors for Improving Visual In-Context Learning☆21Jul 2, 2025Updated last year
- [ICCV23] Official implementation of eP-ALM: Efficient Perceptual Augmentation of Language Models.☆27Oct 27, 2023Updated 3 years ago
- Suri: Multi-constraint instruction following for long-form text generation [EMNLP’24]☆27Oct 3, 2025Updated last year
- This repository contains the source code and related resources for paper:From Isolation to Alignment: Unified LoRA for Efficient Multi-Ta…☆18Jul 23, 2025Updated last year
- [ICML 2025] Official implementation of the paper "SkipGPT: Dynamic Layer Pruning Reinvented with Token Awareness and Module Decoupling". …☆22Nov 17, 2025Updated last year
- ☆23Aug 7, 2023Updated 3 years ago
- ☆28Mar 21, 2024Updated 2 years ago
- ☆26Nov 23, 2023Updated 2 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Software kit for Qualcomm Cloud AI 100☆20Oct 10, 2026Updated last month
- ☆32Nov 4, 2024Updated 2 years ago
- ☆33Jan 1, 2024Updated 2 years ago
- PyTorch implementation of the paper: Decomposing Vision Transformers for Collaborative Inference in Edge Devices☆18Jul 27, 2024Updated 2 years ago
- PyTorch implementation for "Long Horizon Temperature Scaling", ICML 2023☆21May 31, 2023Updated 3 years ago
- This is code of paper "ScalableViT: Rethinking the Context-oriented Generalization of Vision Transformer"☆26Sep 16, 2023Updated 3 years ago
- Code for the paper "Large Language Models Share Representations of Latent Grammatical Concepts Across Typologically Diverse Languages" (N…☆17Apr 13, 2025Updated last year
Are these results useful?