PyTorch implementation of Retentive Network: A Successor to Transformer for Large Language Models
☆14Jul 20, 2023Updated 3 years ago
Alternatives and similar repositories for RetNet
Users that are interested in RetNet are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- an implementation of paper"Retentive Network: A Successor to Transformer for Large Language Models" https://arxiv.org/pdf/2307.08621.pdf☆11Jul 25, 2023Updated 3 years ago
- ☆14Jul 26, 2023Updated 3 years ago
- Huggingface compatible implementation of RetNet (Retentive Networks, https://arxiv.org/pdf/2307.08621.pdf) including parallel, recurrent,…☆227Mar 12, 2024Updated 2 years ago
- Custom Keras layers for implementing multi-dimensional recurrent neural networks (MDRNNs) described in Alex Graves's paper https://arxiv.…☆10Apr 27, 2020Updated 6 years ago
- Interactive Continual Semantic Segmentation☆12Apr 13, 2022Updated 4 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- HyFormer: Hybrid Transformer and CNN For Pixel-level Multispectral Image Classification☆16Feb 15, 2023Updated 3 years ago
- Histopathology Feature Extractors (2024)☆14Jun 14, 2024Updated 2 years ago
- A simple but robust PyTorch implementation of RetNet from "Retentive Network: A Successor to Transformer for Large Language Models" (http…☆105Nov 24, 2023Updated 2 years ago
- Neural Network architecture Visualization tool☆13Jul 4, 2020Updated 6 years ago
- An implementation of "Retentive Network: A Successor to Transformer for Large Language Models"☆1,210Oct 22, 2023Updated 2 years ago
- A graphing calculator written in c.☆15Oct 17, 2023Updated 2 years ago
- Find context neurons in Pythia models.☆13Jun 13, 2023Updated 3 years ago
- ☆15Jan 17, 2024Updated 2 years ago
- a simple programming language under development☆11Dec 3, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆34Jan 9, 2024Updated 2 years ago
- Unofficial implementation of paper : Exploring the Space of Key-Value-Query Models with Intention☆12May 24, 2023Updated 3 years ago
- Multidimensional RNN in Keras Tensorflow☆20Feb 24, 2020Updated 6 years ago
- ☆18Jun 30, 2023Updated 3 years ago
- there are UKIJ and Uighursoft fonts☆13Oct 21, 2022Updated 3 years ago
- Implementation of the Mamba SSM with hf_integration.☆56Aug 31, 2024Updated last year
- 使用自然语言绘制流程图，基于OpenAI☆12Nov 13, 2023Updated 2 years ago
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆15Jan 18, 2025Updated last year
- Repo for our work "Systematic Evaluation of Large Vision-Language Models for Surgical Artificial Intelligence"☆21Jun 2, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Notebooks for RAG optimization workshop, using HackerNews data☆21Updated this week
- ☆15Jun 8, 2026Updated 2 months ago
- The Swin-UNet is a version of the widely used U-Net architecture that combines the windowed attention mechanism of Swin transfomer with t…☆28Feb 17, 2024Updated 2 years ago
- Code for "The Geometry of Concepts: Sparse Autoencoder Feature Structure"☆17Mar 25, 2025Updated last year
- ☆45Nov 1, 2025Updated 9 months ago
- dashboard module for emoncms☆14Jun 9, 2026Updated 2 months ago
- Code release for "TinySpeech: Attention Condensers for Deep Speech Recognition Neural Networks on Edge Devices"☆23Jun 7, 2025Updated last year
- Implementation of Spectral State Space Models☆16Feb 23, 2024Updated 2 years ago
- Official PyTorch Implementation of the Longhorn Deep State Space Model☆56Dec 4, 2024Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Make N-Gram for Uyghur language☆15Dec 24, 2020Updated 5 years ago
- Visualize neural networks using TikZ in Julia☆15Jan 29, 2025Updated last year
- Implementation of Reinforce for educational purposes.☆13Jun 12, 2023Updated 3 years ago
- Dialogue Act classification☆18Jan 15, 2024Updated 2 years ago
- Fast Pythonic data structures and tools for wrangling medical images.☆28Jul 21, 2025Updated last year
- Source code for 'Building Arduino Projects for the Internet of Things' by Adeel Javed☆23Mar 30, 2017Updated 9 years ago
- Rust SDK and CLI for Swarm Framework with Multi-Agent Orchestration☆17Apr 10, 2025Updated last year