facebookresearch / CATransformersLinks
CATransformers is a framework for joint neural network and hardware architecture search.
☆17Updated 5 months ago
Alternatives and similar repositories for CATransformers
Users that are interested in CATransformers are comparing it to the libraries listed below
Sorting:
- Code and pretrained models for the paper: "MatMamba: A Matryoshka State Space Model"☆61Updated 10 months ago
- RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best…☆53Updated 7 months ago
- Explorations into improving ViTArc with Slot Attention☆43Updated last year
- Exploration into the Scaling Value Iteration Networks paper, from Schmidhuber's group☆37Updated last year
- Implementation of the proposed Spline-Based Transformer from Disney Research☆104Updated 11 months ago
- Python library for building and running distributed data pipelines using Ray☆37Updated 3 weeks ago
- Exploration into the Firefly algorithm in Pytorch☆41Updated 8 months ago
- Pixel Parsing. A reproduction of OCR-free end-to-end document understanding models with open data☆21Updated last year
- MobileLLM-R1☆44Updated 2 weeks ago
- [ICML 2025] Roll the dice & look before you leap: Going beyond the creative limits of next-token prediction☆72Updated 4 months ago
- Exploration into the proposed "Self Reasoning Tokens" by Felipe Bonetto☆57Updated last year
- Implementation of a transformer for reinforcement learning using `x-transformers`☆69Updated 3 weeks ago
- Implementation of Mind Evolution, Evolving Deeper LLM Thinking, from Deepmind☆57Updated 4 months ago
- Official Code Repository for EnvGen: Generating and Adapting Environments via LLMs for Training Embodied Agents (COLM 2024)☆38Updated last year
- NeuMeta transforms neural networks by allowing a single model to adapt on the fly to different sizes, generating the right weights when n…☆43Updated 11 months ago
- Flash Attention Triton kernel with support for second-order derivatives☆101Updated last week
- Experimental scripts for researching data adaptive learning rate scheduling.☆22Updated 2 years ago
- ICLR 2025 - official implementation for "I-Con: A Unifying Framework for Representation Learning"☆111Updated 3 months ago
- Just another reasonably minimal repo for class-conditional training of pixel-space diffusion transformers.☆130Updated 4 months ago
- [CVPR 2025] Parallel Sequence Modeling via Generalized Spatial Propagation Network☆106Updated 3 months ago
- ☆105Updated 3 weeks ago
- Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Models. TMLR 2025.☆113Updated last month
- ☆72Updated 2 months ago
- KV Cache Steering for Inducing Reasoning in Small Language Models☆40Updated 2 months ago
- Train, tune, and infer Bamba model☆134Updated 4 months ago
- The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…☆101Updated last week
- Implementation of the premier Text to Video model from OpenAI☆55Updated 11 months ago
- Collection of autoregressive model implementation☆86Updated 5 months ago
- ☆69Updated last year
- This is a simple torch implementation of the high performance Multi-Query Attention☆15Updated 2 years ago