conceptofmind / PaLM-flaxLinks
Implementation of the SOTA Transformer architecture from PaLM - Scaling Language Modeling with Pathways in JAX/Flax
☆14Updated 3 years ago
Alternatives and similar repositories for PaLM-flax
Users that are interested in PaLM-flax are comparing it to the libraries listed below
Sorting:
- Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)☆189Updated 3 years ago
- Implementation of a holodeck, written in Pytorch☆18Updated 2 years ago
- Submissions for AI and Efficiency SOTA's☆56Updated 5 years ago
- My own attempt at a long context genomics model, leveraging recent advances in long context attention modeling (Flash Attention + other h…☆55Updated 2 years ago
- Learned Hyperparameter Optimizers☆59Updated 4 years ago
- 👑 Pytorch code for the Nero optimiser.☆20Updated 3 years ago
- One stop shop for all things carp☆59Updated 3 years ago
- Hugging Face and Pyserini interoperability☆19Updated 2 years ago
- Python Research Framework☆107Updated 3 years ago
- Multi-framework implementation of Deep Kernel Shaping and Tailored Activation Transformations, which are methods that modify neural netwo…☆74Updated 5 months ago
- Neural MMO - A Massively Multiagent Environment for Artificial Intelligence Research☆15Updated last year
- I clearly unravel how I came to invent the supermanifold hypothesis in deep learning, (a part of a system called 'thought curvature') in …☆20Updated 2 years ago
- A GPT, made only of MLPs, in Jax☆58Updated 4 years ago
- ☆26Updated 3 years ago
- ☆26Updated 2 years ago
- JAX implementations of RWKV☆19Updated 2 years ago
- A minimal TPU compatible Jax implementation of NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis.☆13Updated 3 years ago
- URL downloader supporting checkpointing and continuous checksumming.☆19Updated 2 years ago
- ☆62Updated 3 years ago
- Implementation of SelfExtend from the paper "LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning" from Pytorch and Zeta☆13Updated last year
- An attempt to merge ESBN with Transformers, to endow Transformers with the ability to emergently bind symbols☆16Updated 4 years ago
- CUDA implementation of autoregressive linear attention, with all the latest research findings☆46Updated 2 years ago
- ☆40Updated 3 years ago
- Blazing fast training of 🤗 Transformers on Graphcore IPUs☆86Updated last year
- Causal Analysis of Agent Behavior for AI Safety☆19Updated 2 years ago
- RWKV model implementation☆38Updated 2 years ago
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated last year
- ☆71Updated last year
- [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …☆43Updated 2 years ago
- ☆54Updated last year