Unofficial Implementation of Selective Attention Transformer
☆20Oct 31, 2024Updated last year
Alternatives and similar repositories for selective-attention-transformer
Users that are interested in selective-attention-transformer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- codes and plots for "Active-Dormant Attention Heads: Mechanistically Demystifying Extreme-Token Phenomena in LLMs"☆11Dec 30, 2024Updated last year
- Visualize any repo or codebase into diagram or animation☆24Oct 14, 2024Updated last year
- A Qwen .5B reasoning model trained on OpenR1-Math-220k☆14Updated this week
- ☆19Jun 3, 2024Updated 2 years ago
- Unofficial Implementation of Chain-of-Thought Reasoning Without Prompting☆35Mar 19, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Example code of Sparse Gaussian Process Attention (ICLR 2023)☆26Sep 15, 2025Updated 11 months ago
- A no-string API framework for deploying schema-based reasoning into third-party apps☆23Aug 30, 2026Updated last week
- pytorch☆10Apr 13, 2022Updated 4 years ago
- Mixture of Lora Experts☆11Apr 7, 2024Updated 2 years ago
- AI for a cure, a combination of Latent-GAN and VAE-JTNN to create 100% valid drug like molecules☆10Mar 16, 2020Updated 6 years ago
- ☆10Aug 26, 2022Updated 4 years ago
- Code for "Exponential Family Estimation via Adversarial Dynamics Embedding" (NeurIPS 2019)☆14Nov 26, 2019Updated 6 years ago
- ☆19Mar 25, 2025Updated last year
- ☆13Jun 15, 2021Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Unofficial Scalable-Softmax Is Superior for Attention☆21May 30, 2025Updated last year
- ☆13Feb 2, 2023Updated 3 years ago
- Create string diagrams with LaTeX!☆14Jan 3, 2025Updated last year
- Evals meant to evaluate language models' ability to reason over long contexts.☆10Sep 12, 2024Updated last year
- ☆16Apr 26, 2023Updated 3 years ago
- Implementation of SelfExtend from the paper "LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning" from Pytorch and Zeta☆13Nov 11, 2024Updated last year
- Code accompanying VarGrad: A Low-Variance Gradient Estimator for Variational Inference☆12Oct 12, 2020Updated 5 years ago
- personal info☆11Mar 23, 2024Updated 2 years ago
- Bayesian Low-Rank Adaptation of LLMs: BLoB [NeurIPS 2024] and TFB [NeurIPS 2025]☆40Feb 4, 2026Updated 7 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Code to reproduce key results accompanying "SAEs (usually) Transfer Between Base and Chat Models"☆13Jul 18, 2024Updated 2 years ago
- [COLM 2026] An efficient 3D sampling method for long-CoT LLM.☆16May 25, 2025Updated last year
- ☆12Oct 21, 2017Updated 8 years ago
- ☆11Jul 25, 2021Updated 5 years ago
- Demo for ci/cd docker in aws ECS☆11Sep 20, 2018Updated 7 years ago
- [NeurIPS 2024 Datasets and Benchmarks Track] Benchmarking PtO and PnO Methods in the Predictive Combinatorial Optimization Regime☆26Mar 27, 2025Updated last year
- PyTorch utilities for ML, specifically speech☆13Jan 30, 2024Updated 2 years ago
- Implementation of the LDP module block in PyTorch and Zeta from the paper: "MobileVLM: A Fast, Strong and Open Vision Language Assistant …☆15Mar 11, 2024Updated 2 years ago
- Code for 'Answer Matching Outperforms Multiple Choice for Language Model Evaluation' paper☆19Jul 4, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆15Sep 29, 2022Updated 3 years ago
- An automatic Gaussian process classifier.☆13May 28, 2016Updated 10 years ago
- A custom Huggingface trainer which supports logging auxiliary losses returned by your model☆15Jul 27, 2025Updated last year
- SCoRe: Training Language Models to Self-Correct via Reinforcement Learning☆16May 14, 2026Updated 3 months ago
- An implementation of Squared Earth-Mover's Distance loss for Neural Networks.☆14Mar 25, 2023Updated 3 years ago
- This is the code corresponding to my blog post "Generative Adversarial Networks (GANs) for Beginners: Generating Images of Distracted Dri…☆11Feb 5, 2019Updated 7 years ago
- ☆13Feb 16, 2024Updated 2 years ago