conceptofmind / PaLM-flaxLinks
Implementation of the SOTA Transformer architecture from PaLM - Scaling Language Modeling with Pathways in JAX/Flax
☆13Updated 2 years ago
Alternatives and similar repositories for PaLM-flax
Users that are interested in PaLM-flax are comparing it to the libraries listed below
Sorting:
- Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)☆187Updated 2 years ago
- ☆32Updated 2 years ago
- Ongoing research training transformer language models at scale, including: BERT & GPT-2☆18Updated 2 years ago
- A client library for LAION's effort to filter CommonCrawl with CLIP, building a large scale image-text dataset.☆30Updated 2 years ago
- GPT-jax based on the official huggingface library☆13Updated 3 years ago
- Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing☆50Updated 3 years ago
- One stop shop for all things carp☆59Updated 2 years ago
- Learned Hyperparameter Optimizers☆59Updated 4 years ago
- GoldFinch and other hybrid transformer components☆10Updated 3 weeks ago
- Implementation of a holodeck, written in Pytorch☆18Updated last year
- Training hybrid models for dummies.☆21Updated 4 months ago
- ☆21Updated 2 years ago
- A minimal TPU compatible Jax implementation of NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis.☆13Updated 3 years ago
- ☆31Updated last month
- ☆15Updated 2 years ago
- An attempt to merge ESBN with Transformers, to endow Transformers with the ability to emergently bind symbols☆16Updated 3 years ago
- Hugging Face and Pyserini interoperability☆20Updated 2 years ago
- A server powering LAION's effort to filter CommonCrawl with CLIP, building a large scale image-text dataset.☆12Updated 2 years ago
- [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …☆40Updated last year
- Implementation of Metaformer, but in an autoregressive manner☆25Updated 2 years ago
- A library for simplifying fine tuning with multi gpu setups in the Huggingface ecosystem.☆16Updated 7 months ago
- Implementation of "Analysing Mathematical Reasoning Abilities of Neural Models"☆29Updated 2 years ago
- JAX implementations of RWKV☆19Updated last year
- Low-Rank Adaptation of Large Language Models clean implementation☆8Updated last year
- Applying Reinforcement Learning from Human Feedback to language models to teach them to write short story responses to writing prompts.☆14Updated 3 years ago
- URL downloader supporting checkpointing and continuous checksumming.☆19Updated last year
- Python Research Framework☆106Updated 2 years ago
- Image Diffusion block merging technique applied to transformers based Language Models.☆54Updated 2 years ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆19Updated 2 years ago
- ☆44Updated last year