An simple pytorch implementation of Flash MultiHead Attention
☆22Feb 5, 2024Updated 2 years ago
Alternatives and similar repositories for FlashMHA
Users that are interested in FlashMHA are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A simple package for leveraging Falcon 180B and the HF ecosystem's tools, including training/inference scripts, safetensors, integrations…☆12Mar 11, 2024Updated 2 years ago
- Plug in and Play Prompt Technique to Boost Model reasoning by 40%☆12May 30, 2023Updated 3 years ago
- The open source implementation of the multi grouped query attention by the paper "GQA: Training Generalized Multi-Query Transformer Model…☆17Dec 11, 2023Updated 2 years ago
- Open source community's implementation of the model from "LANGUAGE MODEL BEATS DIFFUSION — TOKENIZER IS KEY TO VISUAL GENERATION"☆15Nov 11, 2024Updated last year
- Multi-Modal Multi-Embodied Hivemind-like Iteration of RTX-2☆15Jun 27, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Ultra Fast Multi-Modality Vector Database☆18Feb 21, 2024Updated 2 years ago
- Simple Autogpt with tree of thoughts☆14May 25, 2023Updated 3 years ago
- Transform youtube URL into text 100x faster with whisperx☆20May 8, 2023Updated 3 years ago
- Implementation of "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"☆40Nov 11, 2024Updated last year
- The open source implementation of the model from "Scaling Vision Transformers to 22 Billion Parameters"☆34Jun 22, 2026Updated 2 months ago
- A simple reproducible template to implement AI research papers☆24Sep 9, 2024Updated last year
- Implementation of "Do As I Can, Not As I Say: Grounding Language in Robotic Affordances" by Google☆26Updated this week
- The open source implementation of "AnyMAL: An Efficient and Scalable Any-Modality Augmented Language Model"☆22Jan 27, 2025Updated last year
- 32 times longer context window than vanilla Transformers and up to 4 times longer than memory efficient Transformers.☆51Jun 16, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- The World's First AI-Enabled Multi-Modality Native Search Engine☆26Mar 16, 2024Updated 2 years ago
- Offical Implement of DepthFormer☆12Oct 25, 2022Updated 3 years ago
- The open source implementation of the cross attention mechanism from the paper: "JOINTLY TRAINING LARGE AUTOREGRESSIVE MULTIMODAL MODELS"☆37Mar 11, 2024Updated 2 years ago
- Triton implementation of Flash Attention2.0☆54Jul 31, 2023Updated 3 years ago
- [ICCV 2025] Amodal Depth Anything: Amodal Depth Estimation in the Wild☆42Feb 21, 2026Updated 6 months ago
- Implementation of Adepts Fuyu all-new Multi-Modality model in pytorch☆24Nov 11, 2024Updated last year
- AthenaOS is a next generation AI-native operating system managed by Swarms of AI Agents☆41Jul 18, 2023Updated 3 years ago
- A multi-modal AI Model that can generate high quality novel videos with text, images, or video clips.☆64Aug 18, 2023Updated 3 years ago
- A swarm of LLM agents that will help you test, document, and productionize your code!☆20Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A compiler for a C-like toy language (named "SysY") into ARMv7a assembly, written in C++17☆48Aug 24, 2020Updated 6 years ago
- [ICCV 2025] Official repository of "One Look is Enough"☆19Dec 16, 2025Updated 8 months ago
- My implementation of Kosmos2.5 from the paper: "KOSMOS-2.5: A Multimodal Literate Model"☆75Updated this week
- PySpark-based causal inference package.☆13Aug 20, 2021Updated 5 years ago
- [ICLR 2025] PseDet: Revisiting the Power of Pseudo Label in Incremental Object Detection☆24Sep 16, 2025Updated 11 months ago
- ☆15Sep 25, 2020Updated 5 years ago
- Plug in and play implementation of " Textbooks Are All You Need", ready for training, inference, and dataset generation☆74Sep 18, 2023Updated 2 years ago
- Room Envelopes layout dataset generation code☆16May 6, 2026Updated 3 months ago
- Implementation of Google's USM speech model in Pytorch☆36Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Perturbation-response Score (PS) analysis is a method to quantify diverse perturbation responses and discover novel biological insights i…☆17Apr 20, 2024Updated 2 years ago
- The project here contains the baseband simulation the satellite communication system with DVB-S standards.☆20Dec 14, 2019Updated 6 years ago
- Zeta implementation of a reusable and plug in and play feedforward from the paper "Exponentially Faster Language Modeling"☆16Nov 11, 2024Updated last year
- This package supports implementation of anchor-based topic modeling and variants of the anchoring algorithm in Python 3.☆16Sep 17, 2018Updated 7 years ago
- Simple GUI frontend for CMTK image registration tools in Fiji/ImageJ☆14Nov 7, 2017Updated 8 years ago
- Fine-tune copilot based on your codebase☆12Mar 26, 2024Updated 2 years ago
- A sophisticated multi-agent system designed for real-time market analysis of HTX (formerly Huobi) exchange data. This swarm combines spec…☆11Mar 18, 2025Updated last year