Self contained pytorch implementation of a sinkhorn based router, for mixture of experts or otherwise
☆40Aug 29, 2024Updated last year
Alternatives and similar repositories for sinkhorn-router-pytorch
Users that are interested in sinkhorn-router-pytorch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 삼각형의 실전! Triton☆16Feb 15, 2024Updated 2 years ago
- Exploration into the Scaling Value Iteration Networks paper, from Schmidhuber's group☆37Sep 23, 2024Updated last year
- Implementation of Infini-Transformer in Pytorch☆112Jan 4, 2025Updated last year
- Experimental GPU language with meta-programming☆31Sep 6, 2024Updated last year
- Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts☆122Oct 17, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Implementation of the proposed Adam-atan2 from Google Deepmind in Pytorch☆138Updated this week
- PyTorch Implementation of ViT-TTS (EMNLP'23)☆11Oct 20, 2023Updated 2 years ago
- Pytorch implementation of Transfusion, "Predict the Next Token and Diffuse Images with One Multi-Modal Model", from MetaAI☆1,375Jan 27, 2026Updated 5 months ago
- [CVPR 2024] Code and datasets for 'Learning Spatial Features from Audio-Visual Correspondence in Egocentric Videos'☆13Jun 16, 2024Updated 2 years ago
- ☆21Mar 3, 2025Updated last year
- ☆13Sep 13, 2025Updated 9 months ago
- [ICDCS 2023] DeAR: Accelerating Distributed Deep Learning with Fine-Grained All-Reduce Pipelining☆12Dec 4, 2023Updated 2 years ago
- ☆28Updated this week
- Implementation of an Attention layer where each head can attend to more than just one token, using coordinate descent to pick topk☆47Jul 16, 2023Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Implementation of CALM from the paper "LLM Augmented LLMs: Expanding Capabilities through Composition", out of Google Deepmind☆178Sep 12, 2024Updated last year
- Implementation of a multimodal diffusion transformer in Pytorch☆108Jun 24, 2024Updated 2 years ago
- Implicit Distributional Actor Critic☆11Dec 8, 2021Updated 4 years ago
- ☆14Mar 8, 2025Updated last year
- Implementation of the proposed Spline-Based Transformer from Disney Research☆105Nov 9, 2024Updated last year
- Official code release for Deep Extreme Mixture Model by Wilson, McDonald, Galib, Tan, and Luo.☆10Feb 11, 2022Updated 4 years ago
- Implementation of the proposed MaskBit from Bytedance AI☆82Nov 12, 2024Updated last year
- Utilities for PyTorch distributed☆25Feb 27, 2025Updated last year
- Research code of Cycle Generative Adversarial Networks for Complementary Item Recommendations.☆22Mar 9, 2023Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- KnowLA: Enhancing Parameter-efficient Finetuning with Knowledgeable Adaptation, NAACL 2024☆16Jul 29, 2024Updated last year
- Code for Novel View Acoustic Synthesis paper☆54Aug 14, 2023Updated 2 years ago
- ☆13Jun 2, 2024Updated 2 years ago
- Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"☆104Dec 22, 2024Updated last year
- Tensor Parallelism with JAX + Shard Map☆11Sep 29, 2023Updated 2 years ago
- ☆53Aug 19, 2024Updated last year
- ☆15Oct 19, 2024Updated last year
- Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch☆347Apr 2, 2025Updated last year
- Look Ahead Factor models for quantitative investing using deep learning and uncertainty quantification☆10Jun 25, 2020Updated 6 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Unofficial Implementation of Selective Attention Transformer☆20Oct 31, 2024Updated last year
- ☆14Apr 26, 2018Updated 8 years ago
- Inverse Scaling in Test-Time Compute☆25Dec 3, 2025Updated 7 months ago
- FFT for PyCuda and PyOpenCL. The package is deprecated and its functionality is merged into Reikna.☆37Feb 17, 2014Updated 12 years ago
- Implementation of Gated State Spaces, from the paper "Long Range Language Modeling via Gated State Spaces", in Pytorch☆101Feb 25, 2023Updated 3 years ago
- FLOPS counter for all your GPU benchmarking needs☆13Aug 8, 2024Updated last year
- Just some miscellaneous utility functions / decorators / modules related to Pytorch and Accelerate to help speed up implementation of new…☆126Jul 26, 2024Updated last year