Alternatives and similar repositories for PaLM-flax

Users that are interested in PaLM-flax are comparing it to the libraries listed below

• lucidrains / PaLM-jax
  Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)
  ☆188Updated 3 years ago
• openai / ai-and-efficiency
  Submissions for AI and Efficiency SOTA's
  ☆57Updated 5 years ago
• jxbz / nero
  👑 Pytorch code for the Nero optimiser.
  ☆20Updated 3 years ago
• attentionneuron / attentionneuron.github.io
  ☆26Updated 3 years ago
• openai / LHOPT
  Learned Hyperparameter Optimizers
  ☆60Updated 4 years ago
• NVIDIA / DALI_deps
  3rd party dependencies for DALI project
  ☆10Updated last week
• sholtodouglas / scalingExperiments
  ☆62Updated 3 years ago
• EleutherAI / magiCARP
  One stop shop for all things carp
  ☆59Updated 3 years ago
• EleutherAI / pyfra
  Python Research Framework
  ☆106Updated 3 years ago
• 8bitmp3 / JAX-Flax-Tutorial-Image-Classification-with-Linen
  How to use the Flax Linen API to build a convolutional neural network model and train it for image classification (using TensorFlow Datas…
  ☆24Updated 2 years ago
• lucidrains / holodeck-pytorch
  Implementation of a holodeck, written in Pytorch
  ☆18Updated 2 years ago
• frankxu2004 / gpt-neox
  An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.
  ☆17Updated 3 years ago
• huggingface / gaia
  Hugging Face and Pyserini interoperability
  ☆19Updated 2 years ago
• google-deepmind / dks
  Multi-framework implementation of Deep Kernel Shaping and Tailored Activation Transformations, which are methods that modify neural netwo…
  ☆74Updated 4 months ago
• lucidrains / autoregressive-linear-attention-cuda
  CUDA implementation of autoregressive linear attention, with all the latest research findings
  ☆45Updated 2 years ago
• Quansight-Labs / numpy_pytorch_interop
  ☆20Updated 2 years ago
• lucidrains / flash-genomics-model
  My own attempt at a long context genomics model, leveraging recent advances in long context attention modeling (Flash Attention + other h…
  ☆54Updated 2 years ago
• jaymody / simpleGPT
  Simple implementation of a GPT (training and inference) in PyTorch.
  ☆13Updated last year
• codekansas / rwkv
  RWKV model implementation
  ☆38Updated 2 years ago
• Sea-Snell / JAXSeq
  Train very large language models in Jax.
  ☆209Updated 2 years ago
• EleutherAI / best-download
  URL downloader supporting checkpointing and continuous checksumming.
  ☆19Updated last year
• CarperAI / nmmo-environment
  Neural MMO - A Massively Multiagent Environment for Artificial Intelligence Research
  ☆15Updated last year
• alvarobartt / safejax
  Serialize JAX, Flax, Haiku, or Objax model params with 🤗`safetensors`
  ☆47Updated last year
• google / t5patches
  T5Patches is a set of tools for fast and targeted editing of generative language models built with T5X.
  ☆12Updated last year
• EleutherAI / rnngineering
  Engineering the state of RNN language models (Mamba, RWKV, etc.)
  ☆32Updated last year
• leonard-gleyzer / connex
  Fine-grained, dynamic control of neural network topology in JAX.
  ☆21Updated 2 years ago
• chanind / tensor-theorem-prover
  First-order logic theorem prover supporting unification with approximate vector similarity
  ☆13Updated 2 years ago
• VITA-Group / ChainCoder
  [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …
  ☆42Updated 2 years ago
• aws-neuron / aws-neuron-reference-for-megatron-lm
  ☆14Updated 2 years ago
• tensorpro / tpu_rwkv
  JAX implementations of RWKV
  ☆19Updated 2 years ago