Alternatives and similar repositories for PaLM-flax

Users that are interested in PaLM-flax are comparing it to the libraries listed below

• lucidrains / PaLM-jax
  Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)
  ☆190Updated 3 years ago
• attentionneuron / attentionneuron.github.io
  ☆26Updated 3 years ago
• jxbz / nero
  👑 Pytorch code for the Nero optimiser.
  ☆20Updated 3 years ago
• lucidrains / holodeck-pytorch
  Implementation of a holodeck, written in Pytorch
  ☆18Updated 2 years ago
• EleutherAI / pyfra
  Python Research Framework
  ☆107Updated 3 years ago
• codekansas / rwkv
  RWKV model implementation
  ☆38Updated 2 years ago
• openai / ai-and-efficiency
  Submissions for AI and Efficiency SOTA's
  ☆56Updated 5 years ago
• openai / LHOPT
  Learned Hyperparameter Optimizers
  ☆59Updated 4 years ago
• lucidrains / autoregressive-linear-attention-cuda
  CUDA implementation of autoregressive linear attention, with all the latest research findings
  ☆46Updated 2 years ago
• tensorpro / tpu_rwkv
  JAX implementations of RWKV
  ☆19Updated 2 years ago
• frankxu2004 / gpt-neox
  An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.
  ☆17Updated 3 years ago
• VITA-Group / ChainCoder
  [ICML 2023] "Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation", Wenqing Zheng, S P Sharan, Ajay Kumar Jaiswal, …
  ☆43Updated 2 years ago
• EleutherAI / magiCARP
  One stop shop for all things carp
  ☆59Updated 3 years ago
• HazyResearch / train-tk
  train with kittens!
  ☆63Updated last year
• TheoCoombes / crawlingathome
  A client library for LAION's effort to filter CommonCrawl with CLIP, building a large scale image-text dataset.
  ☆32Updated 2 years ago
• CosineAI / experiments
  Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.
  ☆15Updated last year
• google-deepmind / dks
  Multi-framework implementation of Deep Kernel Shaping and Tailored Activation Transformations, which are methods that modify neural netwo…
  ☆75Updated 7 months ago
• alvarobartt / safejax
  Serialize JAX, Flax, Haiku, or Objax model params with 🤗`safetensors`
  ☆47Updated last year
• sholtodouglas / scalingExperiments
  ☆63Updated 3 years ago
• kyegomez / autogpt-tot
  Simple Autogpt with tree of thoughts
  ☆14Updated 2 years ago
• intel / document-automation
  Document Automation Reference Kit
  ☆15Updated last year
• lucidrains / flash-genomics-model
  My own attempt at a long context genomics model, leveraging recent advances in long context attention modeling (Flash Attention + other h…
  ☆54Updated 2 years ago
• kyegomez / EXA-1
  An EXA-Scale repository of Multi-Modality AI resources from papers and models, to foundational libraries!
  ☆40Updated 2 years ago
• huggingface / gaia
  Hugging Face and Pyserini interoperability
  ☆19Updated 2 years ago
• lucidrains / coordinate-descent-attention
  Implementation of an Attention layer where each head can attend to more than just one token, using coordinate descent to pick topk
  ☆47Updated 2 years ago
• crowsonkb / dice-mc
  DiCE: The Infinitely Differentiable Monte-Carlo Estimator
  ☆32Updated 2 years ago
• JordanMicahBennett / Supermathematics-and-Artificial-General-Intelligence
  I clearly unravel how I came to invent the supermanifold hypothesis in deep learning, (a part of a system called 'thought curvature') in …
  ☆20Updated 2 years ago
• srush / drop7
  ☆18Updated last year
• EleutherAI / rnngineering
  Engineering the state of RNN language models (Mamba, RWKV, etc.)
  ☆32Updated last year
• facebookresearch / FAMBench
  Benchmarks to capture important workloads.
  ☆32Updated last week