conceptofmind / PaLM-flaxLinks
Implementation of the SOTA Transformer architecture from PaLM - Scaling Language Modeling with Pathways in JAX/Flax
☆13Updated 3 years ago
Alternatives and similar repositories for PaLM-flax
Users that are interested in PaLM-flax are comparing it to the libraries listed below
Sorting:
- Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)☆187Updated 3 years ago
- Learned Hyperparameter Optimizers☆59Updated 4 years ago
- An attempt to merge ESBN with Transformers, to endow Transformers with the ability to emergently bind symbols☆16Updated 3 years ago
- Hugging Face and Pyserini interoperability☆20Updated 2 years ago
- ☆60Updated 3 years ago
- ☆39Updated 2 years ago
- Machine Learning eXperiment Utilities☆46Updated last year
- A server powering LAION's effort to filter CommonCrawl with CLIP, building a large scale image-text dataset.☆13Updated 2 years ago
- JAX implementations of RWKV☆19Updated last year
- Implementation of a holodeck, written in Pytorch☆18Updated last year
- [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …☆40Updated last year
- A client library for LAION's effort to filter CommonCrawl with CLIP, building a large scale image-text dataset.☆32Updated 2 years ago
- One stop shop for all things carp☆59Updated 2 years ago
- A minimal TPU compatible Jax implementation of NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis.☆13Updated 3 years ago
- Code associated to papers on superposition (in ML interpretability)☆28Updated 2 years ago
- ☆61Updated this week
- An EXA-Scale repository of Multi-Modality AI resources from papers and models, to foundational libraries!☆41Updated last year
- Training and Inference Notebooks for the RedPajama (OpenLlama) models☆18Updated 2 years ago
- RWKV model implementation☆38Updated last year
- Hugging Face's Zapier Integration 🤗⚡️☆47Updated 2 years ago
- A simple way to manage and store the data related to all your research papers!☆17Updated 2 years ago
- My own attempt at a long context genomics model, leveraging recent advances in long context attention modeling (Flash Attention + other h…☆53Updated last year
- ☆31Updated last week
- ☆18Updated last year
- A library for simplifying fine tuning with multi gpu setups in the Huggingface ecosystem.☆16Updated 8 months ago
- Python Research Framework☆106Updated 2 years ago
- ☆22Updated last year
- Effort to open-source 10.5 trillion parameter Gemini model.☆17Updated last year
- Adaptive Subgoal Search☆19Updated 2 years ago
- Code for the paper "Learning to Prove Theorems by Learning to Generate Theorems"☆32Updated 4 years ago