ClashLuke / tpucare

Related projects ⓘ

Alternatives and complementary repositories for tpucare

• HomebrewNLP / Olmax
  HomebrewNLP in JAX flavour for maintable TPU-Training
  ☆46Updated 10 months ago
• lucidrains / memory-editable-transformer
  My explorations into editing the knowledge and memories of an attention network
  ☆34Updated last year
• google-research / precondition
  ☆29Updated 3 weeks ago
• thecharlieblake / lovely-llama
  An implementation of the Llama architecture, to instruct and delight
  ☆21Updated 3 months ago
• crowsonkb / LDLM
  Latent Diffusion Language Models
  ☆67Updated last year
• cloneofsimo / min-fsdp
  ☆73Updated 4 months ago
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆72Updated 9 months ago
• cloneofsimo / zeroshampoo
  ☆31Updated 2 months ago
• ClashLuke / TrueGrad
  PyTorch interface for TrueGrad Optimizers
  ☆39Updated last year
• evanatyourservice / kron_torch
  An implementation of PSGD Kron second-order optimizer for PyTorch
  ☆16Updated this week
• borisdayma / clip-jax
  Train vision models using JAX and 🤗 transformers
  ☆95Updated 3 weeks ago
• dvruette / barrel-rec-pytorch
  ☆53Updated 10 months ago
• crowsonkb / jax-wavelets
  The 2D discrete wavelet transform for JAX
  ☆38Updated last year
• graphcore-research / out-of-the-box-fp8-training
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆35Updated 4 months ago
• davisyoshida / qax
  If it quacks like a tensor...
  ☆52Updated last week
• ethansmith2000 / TransformerExperiments
  ☆18Updated last month
• HomebrewNLP / HomebrewNLP
  A case study of efficient training of large language models using commodity hardware.
  ☆68Updated 2 years ago
• crowsonkb / dice-mc
  DiCE: The Infinitely Differentiable Monte-Carlo Estimator
  ☆30Updated last year
• crowsonkb / torch-dist-utils
  Utilities for PyTorch distributed
  ☆23Updated last year
• lucidrains / einops-exts
  Implementation of some personal helper functions for Einops, my most favorite tensor manipulation library ❤️
  ☆52Updated last year
• young-geng / mlxu
  Machine Learning eXperiment Utilities
  ☆45Updated 5 months ago
• lucaslingle / mu_transformer
  Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.
  ☆29Updated 2 weeks ago
• davisyoshida / lorax
  LoRA for arbitrary JAX models and functions
  ☆132Updated 8 months ago
• evanatyourservice / psgd_jax
  Implementation of PSGD optimizer in JAX
  ☆17Updated last week
• lucidrains / token-shift-gpt
  Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing
  ☆47Updated 2 years ago
• shikaiqiu / compute-better-spent
  ☆46Updated last month
• cat-state / tinypar
  ☆20Updated last year
• lucidrains / autoregressive-linear-attention-cuda
  CUDA implementation of autoregressive linear attention, with all the latest research findings
  ☆43Updated last year