EleutherAI / pyfra

Related projects ⓘ

Alternatives and complementary repositories for pyfra

• kingoflolz / swarm-jax
  Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes
  ☆237Updated last year
• shawwn / ml-notes
  ☆38Updated last year
• lucidrains / PaLM-jax
  Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)
  ☆185Updated 2 years ago
• lucidrains / mlp-gpt-jax
  A GPT, made only of MLPs, in Jax
  ☆55Updated 3 years ago
• kingoflolz / CLIP_JAX
  Contrastive Language-Image Pretraining
  ☆143Updated 2 years ago
• HomebrewNLP / HomebrewNLP
  A case study of efficient training of large language models using commodity hardware.
  ☆68Updated 2 years ago
• sholtodouglas / scalingExperiments
  ☆57Updated 2 years ago
• lucidrains / g-mlp-gpt
  GPT, but made only out of MLPs
  ☆86Updated 3 years ago
• srush / parallax
  ☆155Updated 4 years ago
• openai / LHOPT
  Learned Hyperparameter Optimizers
  ☆58Updated 3 years ago
• EleutherAI / project-menu
  See the issue board for the current status of active and prospective projects!
  ☆65Updated 2 years ago
• EleutherAI / magiCARP
  One stop shop for all things carp
  ☆59Updated 2 years ago
• RobertCsordas / transformer_generalization
  The official repository for our paper "The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers". We s…
  ☆66Updated last year
• shawwn / tpunicorn
  Babysit your preemptible TPUs
  ☆84Updated last year
• antofuller / configaformers
  A python library for highly configurable transformers - easing model architecture search and experimentation.
  ☆49Updated 2 years ago
• huggingface / bloom-jax-inference
  ☆64Updated 2 years ago
• nestordemeure / flaxOptimizers
  A collection of optimizers, some arcane others well known, for Flax.
  ☆29Updated 3 years ago
• TomFrederik / grokking
  Re-implementation of 'Grokking: Generalization beyond overfitting on small algorithmic datasets'
  ☆38Updated 2 years ago
• openai / ai-and-efficiency
  Submissions for AI and Efficiency SOTA's
  ☆56Updated 4 years ago
• cgarciae / treex
  A Pytree Module system for Deep Learning in JAX
  ☆214Updated last year
• rom1504 / gpu-tester
  gpu tester detects broken and slow gpus in a cluster
  ☆67Updated last year
• krandiash / quinine
  A library to create and manage configuration files, especially for machine learning projects.
  ☆77Updated 2 years ago
• google-research / jestimator
  Amos optimizer with JEstimator lib.
  ☆81Updated 6 months ago
• awf / functional-transformer
  A pure-functional implementation of a machine learning transformer model in Python/JAX
  ☆175Updated 2 years ago
• davisyoshida / haiku-mup
  A port of muP to JAX/Haiku
  ☆25Updated 2 years ago
• Sea-Snell / JAXSeq
  Train very large language models in Jax.
  ☆195Updated last year
• lucidrains / ponder-transformer
  Implementation of a Transformer that Ponders, using the scheme from the PonderNet paper
  ☆79Updated 3 years ago
• yandex-research / DeDLOC
  Official code for "Distributed Deep Learning in Open Collaborations" (NeurIPS 2021)
  ☆116Updated 2 years ago
• lf1-io / padl
  Functional deep learning
  ☆106Updated last year