Alternatives and similar repositories for OST-OpenSourceTransformers

Users that are interested in OST-OpenSourceTransformers are comparing it to the libraries listed below

• erfanzar / eformer
  (EasyDel Former) is a utility library designed to simplify and enhance the development in JAX
  ☆29Updated 3 weeks ago
• Instinct-AI / Xerxes
  Xerxes, a highly advanced Persian AI assistant developed by InstinctAI, a cutting-edge AI startup. primary function is to assist users wi…
  ☆11Updated last year
• erfanzar / EasyDeL
  Accelerate, Optimize performance with streamlined training and serving options with JAX.
  ☆325Updated last week
• erfanzar / jax-flash-attn2
  A flexible and efficient implementation of Flash Attention 2.0 for JAX, supporting multiple backends (GPU/TPU/CPU) and platforms (Triton/…
  ☆32Updated 9 months ago
• erfanzar / Calute
  Agents for intelligence and coordination
  ☆21Updated 3 weeks ago
• yixiaoer / tpu-training-example
  ☆16Updated last year
• AI-Hypercomputer / ray-tpu
  ☆15Updated 7 months ago
• erfanzar / InstinctiveDiffuse
  A cutting-edge text-to-image generator model that leverages state-of-the-art Stable Diffusion Model Type to produce high-quality, realist…
  ☆13Updated last year
• irhum / esmjax
  ESM2 protein language models in JAX/Flax
  ☆17Updated 3 years ago
• cat-state / tinypar
  ☆20Updated 2 years ago
• BlinkDL / SmallInitEmb
  LayerNorm(SmallInit(Embedding)) in a Transformer to improve convergence
  ☆61Updated 3 years ago
• lucidrains / pause-transformer
  Yet another random morning idea to be quickly tried and architecture shared if it works; to allow the transformer to pause for any amount…
  ☆53Updated 2 years ago
• kelechi-c / dit_flow
  DiT (training + flow matching) in Jax
  ☆10Updated 11 months ago
• EleutherAI / training-jacobian
  ☆24Updated last year
• epfml / DenseFormer
  ☆82Updated last year
• ClashLuke / SOAP
  ☆21Updated last year
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆85Updated 8 months ago
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆48Updated 2 years ago
• kyo-takano / chinchilla
  A toolkit for scaling law research ⚖
  ☆53Updated 10 months ago
• davisyoshida / abnormal-floats
  Code for the note "NF4 Isn't Information Theoretically Optimal (and that's Good)
  ☆21Updated 2 years ago
• yixiaoer / tpux
  A set of Python scripts that makes your experience on TPU better
  ☆54Updated 3 months ago
• facebookresearch / Pitfalls-of-Memorization
  Understanding the interplay between memorization and generalization in neural networks, featuring MAT, a learning algorithm to enhance ro…
  ☆40Updated last year
• dvruette / barrel-rec-pytorch
  ☆53Updated last year
• howard-hou / RWKV-X
  RWKV-X is a Linear Complexity Hybrid Language Model based on the RWKV architecture, integrating Sparse Attention to improve the model's l…
  ☆52Updated 5 months ago
• cloneofsimo / fim-llama-deepspeed
  ☆32Updated last year
• huyphan168 / PEER
  Mixture of A Million Experts
  ☆52Updated last year
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆38Updated 6 months ago
• SHI-Labs / CompactNet
  ☆32Updated last year
• argilla-io / distilabel-spin-dibt
  Repository containing the SPIN experiments on the DIBT 10k ranked prompts
  ☆24Updated last year
• warner-benjamin / optimi
  Fast, Modern, and Low Precision PyTorch Optimizers
  ☆118Updated 3 months ago