Experiment on replacing the Scaled Dot-Product Attention in Transformers for a distance-based metric: the Radial Basis Function (RBF) kernel.
☆25Apr 19, 2026Updated 6 months ago
Alternatives and similar repositories for rbf_attention
Users that are interested in rbf_attention are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆69Mar 21, 2025Updated last year
- Something like objdump☆16Jan 23, 2019Updated 7 years ago
- Dataset Generation Code for SimpleStories☆12Dec 19, 2025Updated 10 months ago
- 🦖 A fast & simple neuro-evolution library for Python☆17Feb 11, 2023Updated 3 years ago
- [ICML 2025] On the Emergence of Position Bias in Transformers☆11Nov 12, 2025Updated 11 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆10Aug 14, 2023Updated 3 years ago
- ☆38Jul 8, 2025Updated last year
- LLFree: Lock- and Log-free Allocator☆12Sep 17, 2026Updated last month
- Prediction of compound synthesis accessibility bashed on reaction knowledge graph☆17May 24, 2022Updated 4 years ago
- Image augmentation library for Jax☆44Apr 9, 2024Updated 2 years ago
- Recent application of graph neural network in drug discovery☆14Mar 19, 2020Updated 6 years ago
- Preference-supervised naturalness scorer for modern neural TTS . best way to measure naturalness☆21May 29, 2026Updated 5 months ago
- A PyTorch wrapper of parallel exclusive scan in CUDA☆12May 25, 2023Updated 3 years ago
- Implementation of LatentMoE,Toward Optimal Accuracy per FLOP and Parameter in Mixture of Experts (Elango et al., NVIDIA 2026) — in Pytorc…☆23Jul 22, 2026Updated 3 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- The MaleCNS fruit-fly connectome, run unchanged, plays Doom E1M1 through a hand-built eye and a trained readout☆23Sep 26, 2026Updated last month
- An agenda/schedule/calendar panel for joplin that shows to-dos with due dates☆17Sep 26, 2026Updated last month
- Unofficial implementation of paper : Exploring the Space of Key-Value-Query Models with Intention☆12May 24, 2023Updated 3 years ago
- Markdown and MDX parser in TypeScript. Exact remark mdast output, 17 to 28x faster. Supports streaming parsing for LLM output.☆23Updated this week
- Official Implementation of "Colored Noise Diffusion Sampling" - NeurIPS 2026 Oral☆46Sep 26, 2026Updated last month
- GPU programming module for Argonne Training Program in Extreme Scale Computing 2018☆17Aug 1, 2018Updated 8 years ago
- LLM quantization optimizer☆23Aug 20, 2026Updated 2 months ago
- REBUS: A Robust Evaluation Benchmark of Understanding Symbols☆13Aug 13, 2024Updated 2 years ago
- Repository containing source code of the 10 game environments of Gameworld.☆14Jun 1, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Application and blog explaining my interpretations of In-run Data Shapley☆34Jan 30, 2025Updated last year
- 3D Spiking neural network simulation exploring Spike Timing Dependent Plasticity (STDP)☆11Apr 1, 2026Updated 7 months ago
- ☆12Mar 8, 2026Updated 7 months ago
- Visualization of mean field and neural tangent kernel regime☆23Jul 25, 2024Updated 2 years ago
- Code accompanying "Dynamic Predictive Coding: A Model of Hierarchical Sequence Learning and Prediction in the Neocortex"☆10Mar 2, 2025Updated last year
- [ICLR 2022] Code for paper "Exploring Extreme Parameter Compression for Pre-trained Language Models"(https://arxiv.org/abs/2205.10036)☆22May 24, 2023Updated 3 years ago
- Minimal FlashAttention in CUDA C++/CuTe: readable WMMA/CuTe kernels, no NxN workspace, up to 4.5x faster than naive PyTorch☆30Jun 2, 2026Updated 5 months ago
- Secure and easy to use IaaS stack to manage virtual machines☆15Updated this week
- Generic methods, types and modules for the BioJulia ecosystem.☆12Oct 3, 2026Updated 3 weeks ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆10Dec 15, 2024Updated last year
- A Rust implementation of basic reinforcement learning algorithms with minimal codes☆11Oct 19, 2025Updated last year
- One-step Turkish text-to-speech trained with a drifting objective (Kyutai learned-temperature recipe)☆27Oct 16, 2026Updated 2 weeks ago
- Repository companioning the paper "Learning Unmasking Policies for Diffusion Language Models"☆24Sep 11, 2026Updated last month
- Improving Text-to-Image Models with Large Language Models☆23Oct 18, 2022Updated 4 years ago
- Experiments of the "Multi-Agent Trajectory Planning with NUV Priors" paper☆12Oct 14, 2024Updated 2 years ago
- A collection of Hyperdimensional Computing (HDC) models implemented in C++☆11Jun 14, 2024Updated 2 years ago