facebookresearch / CATransformersLinks
CATransformers is a framework for joint neural network and hardware architecture search.
☆17Updated 6 months ago
Alternatives and similar repositories for CATransformers
Users that are interested in CATransformers are comparing it to the libraries listed below
Sorting:
- RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best…☆53Updated 7 months ago
- Pixel Parsing. A reproduction of OCR-free end-to-end document understanding models with open data☆21Updated last year
- Train, tune, and infer Bamba model☆135Updated 5 months ago
- Code and pretrained models for the paper: "MatMamba: A Matryoshka State Space Model"☆61Updated 11 months ago
- RS-IMLE☆42Updated 11 months ago
- Explorations into improving ViTArc with Slot Attention☆43Updated last year
- Experimental scripts for researching data adaptive learning rate scheduling.☆22Updated 2 years ago
- ☆105Updated 7 months ago
- NeuMeta transforms neural networks by allowing a single model to adapt on the fly to different sizes, generating the right weights when n…☆43Updated last year
- This is a simple torch implementation of the high performance Multi-Query Attention☆15Updated 2 years ago
- Implementation of the proposed Spline-Based Transformer from Disney Research☆105Updated last year
- Python library for building and running distributed data pipelines using Ray☆44Updated last week
- ☆120Updated last month
- imagetokenizer is a python package, helps you encoder visuals and generate visuals token ids from codebook, supports both image and video…☆37Updated last year
- [NeurIPS 2025 Oral] Exploring Diffusion Transformer Designs via Grafting☆61Updated 4 months ago
- [ICML 2025] Roll the dice & look before you leap: Going beyond the creative limits of next-token prediction☆72Updated 5 months ago
- Exploration into the proposed "Self Reasoning Tokens" by Felipe Bonetto☆57Updated last year
- Flash Attention Triton kernel with support for second-order derivatives☆107Updated 2 weeks ago
- DPO, but faster 🚀☆46Updated 11 months ago
- Just another reasonably minimal repo for class-conditional training of pixel-space diffusion transformers.☆131Updated 5 months ago
- ☆72Updated 3 months ago
- Implementation of a multimodal diffusion transformer in Pytorch☆106Updated last year
- Exploration into the Scaling Value Iteration Networks paper, from Schmidhuber's group☆37Updated last year
- Implementation of the proposed MaskBit from Bytedance AI☆82Updated 11 months ago
- MobileLLM-R1☆55Updated last month
- Implementation of a transformer for reinforcement learning using `x-transformers`☆69Updated last month
- Exploration into the Firefly algorithm in Pytorch☆41Updated 8 months ago
- Implementation of a framework for Genie2 in Pytorch☆153Updated 10 months ago
- The official repo of continuous speculative decoding☆30Updated 7 months ago
- Large multi-modal models (L3M) pre-training.☆219Updated last month