conceptofmind / PaLM-flaxLinks
Implementation of the SOTA Transformer architecture from PaLM - Scaling Language Modeling with Pathways in JAX/Flax
☆13Updated 3 years ago
Alternatives and similar repositories for PaLM-flax
Users that are interested in PaLM-flax are comparing it to the libraries listed below
Sorting:
- Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)☆187Updated 3 years ago
- Learned Hyperparameter Optimizers☆59Updated 4 years ago
- Python Research Framework☆106Updated 2 years ago
- One stop shop for all things carp☆59Updated 2 years ago
- Submissions for AI and Efficiency SOTA's☆56Updated 5 years ago
- An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.☆17Updated 3 years ago
- A client library for LAION's effort to filter CommonCrawl with CLIP, building a large scale image-text dataset.☆32Updated 2 years ago
- Hugging Face and Pyserini interoperability☆20Updated 2 years ago
- ☆39Updated 2 years ago
- Implementation of "Analysing Mathematical Reasoning Abilities of Neural Models"☆30Updated 2 years ago
- RWKV model implementation☆38Updated 2 years ago
- [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …☆40Updated last year
- Simple Autogpt with tree of thoughts☆14Updated 2 years ago
- ☆26Updated 2 years ago
- A minimal TPU compatible Jax implementation of NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis.☆13Updated 3 years ago
- JAX implementation ViT-VQGAN☆59Updated 3 years ago
- URL downloader supporting checkpointing and continuous checksumming.☆19Updated last year
- ☆14Updated 2 years ago
- I clearly unravel how I came to invent the supermanifold hypothesis in deep learning, (a part of a system called 'thought curvature') in …☆20Updated 2 years ago
- A case study of efficient training of large language models using commodity hardware.☆68Updated 3 years ago
- A GPT, made only of MLPs, in Jax☆58Updated 4 years ago
- Train very large language models in Jax.☆206Updated last year
- Implementation of a holodeck, written in Pytorch☆18Updated last year
- CUDA implementation of autoregressive linear attention, with all the latest research findings☆44Updated 2 years ago
- JAX implementations of RWKV☆19Updated last year
- 👑 Pytorch code for the Nero optimiser.☆20Updated 2 years ago
- ☆61Updated 3 years ago
- A dataset of alignment research and code to reproduce it☆77Updated 2 years ago
- ☆15Updated last year
- 3rd party dependencies for DALI project☆10Updated this week