Experiment on replacing the Scaled Dot-Product Attention in Transformers for a distance-based metric: the Radial Basis Function (RBF) kernel.
☆25Apr 19, 2026Updated 5 months ago
Alternatives and similar repositories for rbf_attention
Users that are interested in rbf_attention are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code for EMNLP 2022 Paper: On the Calibration of Massively Multilingual Language Models☆15Jun 12, 2023Updated 3 years ago
- ☆17Dec 19, 2024Updated last year
- Official codes for COLING 2024 paper "Robust and Scalable Model Editing for Large Language Models": https://arxiv.org/abs/2403.17431v1☆14Mar 27, 2024Updated 2 years ago
- ☆10Aug 14, 2023Updated 3 years ago
- 🦖 A fast & simple neuro-evolution library for Python☆17Feb 11, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆38Jul 8, 2025Updated last year
- A curated list of resources related to training of GANs☆31Oct 21, 2020Updated 5 years ago
- Image augmentation library for Jax☆44Apr 9, 2024Updated 2 years ago
- A side project that follows all the acceleration tricks in tinyllama, with the minimal modification to the huggingface transformers code.☆13Sep 2, 2024Updated 2 years ago
- RoPE attention is an exact forward-pass gradient step with softmax intact☆57Sep 6, 2026Updated 2 weeks ago
- [ICLR 2022] Code for paper "Exploring Extreme Parameter Compression for Pre-trained Language Models"(https://arxiv.org/abs/2205.10036)☆22May 24, 2023Updated 3 years ago
- GPU programming module for Argonne Training Program in Extreme Scale Computing 2018☆17Aug 1, 2018Updated 8 years ago
- REBUS: A Robust Evaluation Benchmark of Understanding Symbols☆13Aug 13, 2024Updated 2 years ago
- Experiments of the "Multi-Agent Trajectory Planning with NUV Priors" paper☆12Oct 14, 2024Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Official repository for the paper "Exploring the Promise and Limits of Real-Time Recurrent Learning" (ICLR 2024)☆13Jun 11, 2025Updated last year
- The official Github Repo and Download for the FNAF Mod☆10Nov 10, 2015Updated 10 years ago
- continous batching and parallel acceleration for RWKV6☆23Jun 28, 2024Updated 2 years ago
- DashAttention: Differentiable and Adaptive Sparse Hierarchical Attention☆23May 25, 2026Updated 3 months ago
- Ainari contains an experimental artificial neural network, which can work on unnormalized input-data in a cloud native environment.☆15Updated this week
- Evolutionary Search for expert-level performance on any task with environmental feedback☆14Oct 12, 2025Updated 11 months ago
- https://hf.co/hexgrad/Kokoro-82M☆14Jan 14, 2026Updated 8 months ago
- openapi of all third-party☆10Updated this week
- ☆19Mar 17, 2026Updated 6 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- This is a repository for the paper: "Sequence anticipation and spike-timing-dependent plasticity emerge from a predictive learning rule" …☆12Jun 2, 2024Updated 2 years ago
- Neural Networks for JAX☆84Sep 24, 2024Updated last year
- An OpenAI wrapper for PyReason to use in a Grid World reinforcement learning setting☆32Dec 28, 2023Updated 2 years ago
- Cuda kernels for leveraging LLM sparsity to improve throughput and decrease the memory requirements during inference and training.☆264Jun 29, 2026Updated 2 months ago
- Code for the paper 'Neural Variational Gradient Descent'. We perform nonparametric variational inference by transporting samples along a …☆12Jul 29, 2021Updated 5 years ago
- Prediction of glycopeptide fragment mass spectra by deep learning☆12Feb 20, 2024Updated 2 years ago
- GNOME Shell extension for time tracking☆26Mar 2, 2024Updated 2 years ago
- ☆12Apr 8, 2021Updated 5 years ago
- A repository with comprehensive instructions for using the Festvox toolkit for generating Emotional speech from text☆50Dec 30, 2022Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Advancement at the intersection of cognitive science, temporal knowledge graphs, database systems, and AI.☆15Jul 26, 2026Updated last month
- This is a simple python script to retarget a rig in blender from a radical capture to a rig imported from Daz3D☆10Oct 10, 2020Updated 5 years ago
- A realtime multicellular organism evolution simulator with Verlet integration☆13May 30, 2021Updated 5 years ago
- ☆16May 23, 2026Updated 3 months ago
- zero-code hyperparameters optimization framework☆14Jan 25, 2024Updated 2 years ago
- This repositories contains the reference implementation for the Sparse Delta Memory paper.More precisely, it contains the model definitio…☆39Jul 9, 2026Updated 2 months ago
- Large dataset storage format for Pytorch☆44Aug 19, 2021Updated 5 years ago