conceptofmind / PaLM-flaxLinks
Implementation of the SOTA Transformer architecture from PaLM - Scaling Language Modeling with Pathways in JAX/Flax
☆14Updated 3 years ago
Alternatives and similar repositories for PaLM-flax
Users that are interested in PaLM-flax are comparing it to the libraries listed below
Sorting:
- Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)☆189Updated 3 years ago
- Submissions for AI and Efficiency SOTA's☆56Updated 5 years ago
- Multi-framework implementation of Deep Kernel Shaping and Tailored Activation Transformations, which are methods that modify neural netwo…☆74Updated 4 months ago
- 👑 Pytorch code for the Nero optimiser.☆20Updated 3 years ago
- Learned Hyperparameter Optimizers☆59Updated 4 years ago
- A minimal TPU compatible Jax implementation of NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis.☆13Updated 3 years ago
- RWKV model implementation☆38Updated 2 years ago
- Hugging Face and Pyserini interoperability☆19Updated 2 years ago
- Implementation of a holodeck, written in Pytorch☆18Updated 2 years ago
- Python Research Framework☆106Updated 3 years ago
- ☆26Updated 2 years ago
- One stop shop for all things carp☆59Updated 3 years ago
- I clearly unravel how I came to invent the supermanifold hypothesis in deep learning, (a part of a system called 'thought curvature') in …☆20Updated 2 years ago
- ☆26Updated 3 years ago
- ☆79Updated this week
- A GPT, made only of MLPs, in Jax☆58Updated 4 years ago
- JAX implementations of RWKV☆19Updated 2 years ago
- [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …☆43Updated 2 years ago
- ☆62Updated 3 years ago
- ☆40Updated 2 years ago
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated last year
- This repository hosts the code to port NumPy model weights of BiT-ResNets to TensorFlow SavedModel format.☆14Updated 3 years ago
- My own attempt at a long context genomics model, leveraging recent advances in long context attention modeling (Flash Attention + other h…☆55Updated 2 years ago
- A client library for LAION's effort to filter CommonCrawl with CLIP, building a large scale image-text dataset.☆32Updated 2 years ago
- 3rd party dependencies for DALI project☆10Updated this week
- ☆34Updated 2 years ago
- An environment for learning formal mathematical reasoning from scratch☆70Updated last year
- ☆26Updated 2 years ago
- Blazing fast training of 🤗 Transformers on Graphcore IPUs☆85Updated last year
- Implementation of "Analysing Mathematical Reasoning Abilities of Neural Models"☆30Updated 2 years ago