An open source community implementation of the model from "DIFFERENTIAL TRANSFORMER" paper by Microsoft.
☆41Oct 26, 2026Updated this week
Alternatives and similar repositories for DifferentialTransformer
Users that are interested in DifferentialTransformer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- PyTorch implementation of the Differential-Transformer architecture for sequence modeling, specifically tailored as a decoder-only model …☆86Oct 27, 2024Updated 2 years ago
- ☆13Oct 14, 2024Updated 2 years ago
- ☆27Oct 12, 2024Updated 2 years ago
- A swarm of LLM agents that will help you test, document, and productionize your code!☆20Oct 13, 2026Updated 2 weeks ago
- Zeta implemantion of "Rethinking Attention: Exploring Shallow Feed-Forward Neural Networks as an Alternative to Attention Layers in Trans…☆12Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [ICCV 2025] Implementation of "TR-PTS: Task-Relevant Parameter and Token Selection for Efficient Tuning"☆12Jul 30, 2025Updated last year
- OpioidRL is a cutting-edge reinforcement learning (RL) library that simulates drug addiction behaviors within RL agents. Inspired by the …☆11Updated this week
- Implementation of the paper: "Aurora: A Foundation Model of the Atmosphere" in PyTorch☆24Updated this week
- OmegaViT (ΩViT) is a cutting-edge vision transformer architecture that combines multi-query attention, rotary embeddings, state space mod…☆15Updated this week
- OmniByteFormer is a generalized Transformer model that can process any type of data by converting it into byte sequences, bypassing tradi…☆17Updated this week
- Implementation of "Audio xLSTMs: Learning Self-supervised audio representations with xLSTMs" in PyTorch☆20Updated this week
- Train a production grade GPT in less than 400 lines of code. Better than Karpathy's verison and GIGAGPT☆17Updated this week
- CogNetX is an advanced, multimodal neural network architecture inspired by human cognition. It integrates speech, vision, and video proce…☆22Updated this week
- PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"☆26Oct 18, 2026Updated last week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- An open source implementation of R1☆31Updated this week
- Wayformer self Implement☆16Nov 23, 2022Updated 3 years ago
- an unfollow script to search for followed people that don't follow back.☆12Apr 10, 2026Updated 6 months ago
- Implementation of the model: "Reka Core, Flash, and Edge: A Series of Powerful Multimodal Language Models" in PyTorch☆29Updated this week
- Welcome to AGI, the cutting-edge project dedicated to building the core components of Artificial General Intelligence.☆18Oct 19, 2026Updated last week
- Implementation of MambaFormer in Pytorch ++ Zeta from the paper: "Can Mamba Learn How to Learn? A Comparative Study on In-Context Learnin…☆23Oct 14, 2026Updated 2 weeks ago
- Bidirectional Motion Transformer for Safety-Critical Traffic Scenario Generation☆14Nov 18, 2025Updated 11 months ago
- Pytorch Implementation of the paper: "Learning to (Learn at Test Time): RNNs with Expressive Hidden States"☆24Oct 13, 2026Updated 2 weeks ago
- Investigating the benefit of relating river gauging stations via graph neural networks for flood forecasting☆17Mar 31, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Community Open Source Implementation of GPT4o in PyTorch☆33Oct 19, 2026Updated last week
- Automation tool that follows GitHub users based on smart algorithms to analyze behavior and increase chances of getting follow-backs.☆13Feb 7, 2026Updated 8 months ago
- A simple and minimal open source implementation of "Introducing LFM2: The Fastest On-Device Foundation Models on the Market" from Liquid …☆33Oct 14, 2026Updated 2 weeks ago
- Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…☆59Oct 13, 2026Updated 2 weeks ago
- Community Implementation of the paper: "Multi-Head Mixture-of-Experts" In PyTorch☆31Updated this week
- 实时交互输入辅助工具☆10Apr 7, 2022Updated 4 years ago
- Ada projects for Make-with-Ada☆13Feb 18, 2026Updated 8 months ago
- [ICCV 2025] TurboTrain: Towards Efficient and Balanced Multi-Task Learning for Multi-Agent Perception and Prediction.☆17Jan 31, 2026Updated 8 months ago
- The official implementation of "A Conformation-Centric Generative Foundation Model for Linear Polymer Modeling and Design"☆15May 9, 2026Updated 5 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Implementation of "Do As I Can, Not As I Say: Grounding Language in Robotic Affordances" by Google☆26Oct 10, 2026Updated 2 weeks ago
- LatentMAS with kNN kv cache pruning | up to 40% more memory efficient and 30% faster☆20Dec 10, 2025Updated 10 months ago
- scrapes a couple sites for personal use, dont copy☆18Apr 19, 2026Updated 6 months ago
- ARC Humanoid Robot Training for Isaac Lab☆13Jul 25, 2025Updated last year
- ☆10Dec 6, 2024Updated last year
- Implementation of the "the first large-scale multimodal mixture of experts models." from the paper: "Multimodal Contrastive Learning with…☆36Oct 10, 2026Updated 2 weeks ago
- [TPAMI 2026] UniMM: A Unified Mixture Model Framework for Multi-Agent Simulation☆26Jun 18, 2026Updated 4 months ago