The official code of "Building on Efficient Foundations: Effectively Training LLMs with Structured Feedforward Layers"
☆20Jul 24, 2024Updated 2 years ago
Alternatives and similar repositories for StructuredFFN
Users that are interested in StructuredFFN are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official code for the NeurIPS25 paper "RAT: Bridging RNN Efficiencyand Attention Accuracy in Language Modeling" (https://arxiv.org/abs/25…☆26Aug 31, 2026Updated 2 weeks ago
- Official codebase for "Quantile Reward Policy Optimization: Alignment with Pointwise Regression and Exact Partition Functions" (Matrenok …☆30Dec 8, 2025Updated 9 months ago
- Grokking on modular arithmetic in less than 150 epochs in MLX☆15Oct 24, 2024Updated last year
- A template for starting reproducible Python machine-learning projects with hardware acceleration. Find an example at https://github.com/C…☆121Jun 6, 2025Updated last year
- ☆72Sep 11, 2026Updated last week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Simple GRPO scripts and configurations.☆59Feb 6, 2025Updated last year
- manipulating cointegrated pairs to achieve a market-neutral strategy that outperforms indices☆11Jan 12, 2021Updated 5 years ago
- Automatically exported from code.google.com/p/transducersaurus☆11Apr 1, 2015Updated 11 years ago
- Easily deploy my zsh and tmux configuration on new machines. Includes local and remote aliases to improve workflow.☆16Apr 23, 2026Updated 4 months ago
- Materials for the Deep Learning 2 course at HSE AMI☆26Nov 26, 2024Updated last year
- Training, optimization and deployment of Object Detection model with dinov2 backbone for efficient inference on NVIDIA Jetson☆14Jul 26, 2025Updated last year
- This repository provides a collection of LaTeX class templates designed to enhance the clarity and conciseness of the main.tex files. It …☆13Sep 11, 2026Updated last week
- torchvision-based transforms that provide access to parameterization☆13Sep 11, 2026Updated last week
- AI Control evaluation library. Built natively on Inspect AI.☆17Feb 25, 2026Updated 6 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Structured Neuron Level Pruning to compress Transformer-based models [ECCV'24]☆16Aug 7, 2024Updated 2 years ago
- Continuous regular group convolutions for Pytorch☆12Jun 9, 2024Updated 2 years ago
- 🧞♀️ Discover AI-generated programming project ideas☆10Sep 2, 2022Updated 4 years ago
- coloring terminal text with intensities (used for plotting probability, entropy with tokens)☆12Oct 11, 2024Updated last year
- A few models converted from caffe to CoreMLs format.☆15Jun 6, 2017Updated 9 years ago
- Mastodon server running for the Doubanius Tertius project☆10Apr 4, 2022Updated 4 years ago
- ☆11Sep 9, 2024Updated 2 years ago
- Scratchpad/Chain-of-Thought Prompts☆12Jun 6, 2022Updated 4 years ago
- A Statistical Arbitrage Strategy to trade Cryptocurrency Pairs☆14Nov 6, 2020Updated 5 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆25May 25, 2024Updated 2 years ago
- KGML for EMNLP 2021☆10Feb 2, 2022Updated 4 years ago
- Code to generate visual metamers via foveated feed-forward style transfer (ICLR 2019)☆19Apr 13, 2021Updated 5 years ago
- Fast and differentiable hidden Markov model in C++☆19Jan 20, 2023Updated 3 years ago
- some papers about Kalman Filter☆16Sep 4, 2019Updated 7 years ago
- ☆14Mar 2, 2025Updated last year
- [ICML 2026] Scaling Beyond Masked Diffusion Language Models☆37Sep 7, 2026Updated last week
- Elucidated Dataset Condensation (NeurIPS 2024)☆20Oct 5, 2024Updated last year
- Source code for the paper "Positional Attention: Expressivity and Learnability of Algorithmic Computation"☆14May 26, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Official implementation for LaCo (EMNLP 2024 Findings)☆22Oct 3, 2024Updated last year
- Temporal Alignment Prediction for Supervised Representation Learning and Few-Shot Sequence Classification☆12Feb 5, 2022Updated 4 years ago
- Course on diffusion models and modern generative modeling foundations taught at the Faculty of Computer Science of HSE University☆47Jun 27, 2026Updated 2 months ago
- ECHO: Frequency-aware Hierarchical Encoding for Variable-length Signal☆20Jul 3, 2026Updated 2 months ago
- ☆63Oct 3, 2024Updated last year
- This is the code which powers the Twitter Bot https://twitter.com/RGB_Colours☆15Apr 14, 2017Updated 9 years ago
- Experiments Notebook of "Understanding the Skill Gap in Recurrent Language Models: The Role of the Gather-and-Aggregate Mechanism"☆17Apr 30, 2025Updated last year