Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"
☆58Oct 27, 2025Updated last year
Alternatives and similar repositories for Griffin
Users that are interested in Griffin are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Jax implementation of "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"☆16May 10, 2024Updated 2 years ago
- Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models☆15Oct 22, 2026Updated last week
- Griffin MQA + Hawk Linear RNN Hybrid☆88Apr 13, 2026Updated 6 months ago
- ☆107Mar 9, 2024Updated 2 years ago
- HGRN2: Gated Linear RNNs with State Expansion☆59Aug 20, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- A repository for DenseSSMs☆91Apr 11, 2024Updated 2 years ago
- ☆24Sep 25, 2024Updated 2 years ago
- Vossian Antonomasia☆10Sep 28, 2026Updated last month
- Implementations of various linear RNN layers using pytorch and triton☆55Aug 4, 2023Updated 3 years ago
- Implementation of MambaFormer in Pytorch ++ Zeta from the paper: "Can Mamba Learn How to Learn? A Comparative Study on In-Context Learnin…☆23Oct 14, 2026Updated 2 weeks ago
- Research into identifying and correcting incorrect labels in the CoNLL-2003 corpus.☆12May 11, 2021Updated 5 years ago
- Towards Diverse and Coherent Augmentation for Time-Series Forecasting☆13May 28, 2023Updated 3 years ago
- Open weights language model from Google DeepMind, based on Griffin.☆685Feb 6, 2026Updated 8 months ago
- Fast brown clustering using python☆10Aug 21, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"☆223Oct 26, 2026Updated last week
- Non official implementation of the Linear Recurrent Unit (LRU, Orvieto et al. 2023)☆65Sep 3, 2025Updated last year
- Transformer model based on Kolmogorov–Arnold Network(KAN), which is an alternative of Multi-Layer Perceptron(MLP)☆29Jul 1, 2026Updated 4 months ago
- Implementation for IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUs (ICLR 2024).☆25Jun 9, 2026Updated 4 months ago
- Evaluate language models using multiple choice items☆14Mar 6, 2026Updated 7 months ago
- Implementation of M2PT in PyTorch from the paper: "Multimodal Pathway: Improve Transformers with Irrelevant Data from Other Modalities"☆14Mar 11, 2024Updated 2 years ago
- 影像组学特征提取demo☆12Apr 10, 2024Updated 2 years ago
- Taxonomy-aware Multi-dataset Joint Training for Video Instance Segmentation (NeurIPS 23)☆12May 7, 2025Updated last year
- ☆10Jan 20, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Self-Attention Graph Pooling [ICML-2019]☆10Apr 19, 2024Updated 2 years ago
- Lip Reading for Low-resource Languages by Learning and Combining General Speech Knowledge and Language-specific Knowledge (ICCV 2023)☆11Sep 3, 2024Updated 2 years ago
- Yet another random morning idea to be quickly tried and architecture shared if it works; to allow the transformer to pause for any amount…☆53Oct 22, 2023Updated 3 years ago
- Implementation of "PaLM2-VAdapter:" from the multi-modal model paper: "PaLM2-VAdapter: Progressively Aligned Language Model Makes a Stron…☆17Nov 11, 2024Updated last year
- Code for "Few-Shot Learning by Dimensionality Reduction in Gradient Space"☆14Jan 27, 2023Updated 3 years ago
- LongAttn ：Selecting Long-context Training Data via Token-level Attention☆15Jul 16, 2025Updated last year
- [ICCV 2023] CTVIS: Consistent Training for Online Video Instance Segmentation☆84Oct 15, 2023Updated 3 years ago
- Fourier Spatial-Temporal Network for Multivariate Time Series Forecasting☆11Jan 1, 2023Updated 3 years ago
- Easy & Pretrained SOTA Deep Learning for RNA strings☆12Apr 15, 2022Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- The official Languini Kitchen repository☆14May 6, 2024Updated 2 years ago
- Reproduction of ScConv(CVPR 2023)☆10Sep 14, 2023Updated 3 years ago
- A Triton Kernel for incorporating Bi-Directionality in Mamba2☆82Dec 18, 2024Updated last year
- ☆12Feb 19, 2024Updated 2 years ago
- Annotated version of the Mamba paper☆504Feb 27, 2024Updated 2 years ago
- Code repository for the public reproduction of the language modelling experiments on "MatFormer: Nested Transformer for Elastic Inference…☆32Nov 14, 2023Updated 2 years ago
- Dynamic brain connectome analysis toolbox☆18Jan 26, 2023Updated 3 years ago