Alternatives and similar repositories for OST-OpenSourceTransformers

Users that are interested in OST-OpenSourceTransformers are comparing it to the libraries listed below

• Instinct-AI / Xerxes
  Xerxes, a highly advanced Persian AI assistant developed by InstinctAI, a cutting-edge AI startup. primary function is to assist users wi…
  ☆11Updated last year
• erfanzar / eformer
  (EasyDel Former) is a utility library designed to simplify and enhance the development in JAX
  ☆28Updated last week
• erfanzar / jax-flash-attn2
  A flexible and efficient implementation of Flash Attention 2.0 for JAX, supporting multiple backends (GPU/TPU/CPU) and platforms (Triton/…
  ☆27Updated 6 months ago
• erfanzar / InstinctiveDiffuse
  A cutting-edge text-to-image generator model that leverages state-of-the-art Stable Diffusion Model Type to produce high-quality, realist…
  ☆13Updated last year
• erfanzar / EasyDeL
  Accelerate, Optimize performance with streamlined training and serving options with JAX.
  ☆310Updated this week
• yixiaoer / tpu-training-example
  ☆15Updated last year
• AI-Hypercomputer / ray-tpu
  ☆15Updated 4 months ago
• lucidrains / llama-qrlhf
  Implementation of the Llama architecture with RLHF + Q-learning
  ☆166Updated 7 months ago
• ayaka14732 / llama-2-jax
  JAX implementation of the Llama 2 model
  ☆219Updated last year
• lucidrains / pause-transformer
  Yet another random morning idea to be quickly tried and architecture shared if it works; to allow the transformer to pause for any amount…
  ☆53Updated last year
• kyleliang919 / Long-context-transformers
  Exploring finetuning public checkpoints on filter 8K sequences on Pile
  ☆116Updated 2 years ago
• microsoft / mutransformers
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆82Updated 3 years ago
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆48Updated last year
• ClashLuke / SOAP
  ☆21Updated 10 months ago
• lucidrains / memory-editable-transformer
  My explorations into editing the knowledge and memories of an attention network
  ☆35Updated 2 years ago
• lucidrains / mixture-of-attention
  Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts
  ☆121Updated 11 months ago
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆86Updated 4 months ago
• yixiaoer / tpux
  A set of Python scripts that makes your experience on TPU better
  ☆54Updated last year
• qwopqwop200 / gptqlora
  GPTQLoRA: Efficient Finetuning of Quantized LLMs with GPTQ
  ☆103Updated 2 years ago
• HomebrewML / Olmax
  HomebrewNLP in JAX flavour for maintable TPU-Training
  ☆50Updated last year
• SmerkyG / RWKV_Explained
  RWKV, in easy to read code
  ☆71Updated 5 months ago
• huyphan168 / PEER
  Mixture of A Million Experts
  ☆47Updated last year
• kjslag / spacebyte
  A byte-level decoder architecture that matches the performance of tokenized Transformers.
  ☆65Updated last year
• luyug / magix
  Supercharge huggingface transformers with model parallelism.
  ☆77Updated last month
• CarperAI / treasure_trove
  ☆22Updated 2 years ago
• hydrallm / llama-moe-v1
  ☆96Updated 2 years ago
• VatsaDev / NanoPoor
  NanoGPT-speedrunning for the poor T4 enjoyers
  ☆71Updated 4 months ago
• melisa-writer / short-transformers
  Prune transformer layers
  ☆69Updated last year
• ingur / bitlinear-pytorch
  Implementation of the BitLinear layer from: The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits
  ☆13Updated last year
• warner-benjamin / optimi
  Fast, Modern, and Low Precision PyTorch Optimizers
  ☆109Updated last week