Alternatives and similar repositories for transformer

Users that are interested in transformer are comparing it to the libraries listed below

• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆122Updated 2 years ago
• tintn / vision-transformer-from-scratch
  A Simplified PyTorch Implementation of Vision Transformer (ViT)
  ☆235Updated last year
• ajhalthor / Transformer-Neural-Network
  Code Transformer neural network components piece by piece
  ☆372Updated 2 years ago
• jsbaan / transformer-from-scratch
  Well documented, unit tested, type checked and formatted implementation of a vanilla transformer - for educational purposes.
  ☆282Updated last year
• sgrvinod / a-PyTorch-Tutorial-to-Transformers
  Attention Is All You Need | a PyTorch Tutorial to Transformers
  ☆362Updated last year
• hkproj / pytorch-llama
  LLaMA 2 implemented from scratch in PyTorch
  ☆366Updated 2 years ago
• Jaykef / ai-algorithms
  First-principle implementations of groundbreaking AI algorithms using a wide range of deep learning frameworks, accompanied by supporting…
  ☆181Updated 6 months ago
• mishra-18 / ML-Models
  ☆48Updated 7 months ago
• hkproj / pytorch-transformer
  Attention is all you need implementation
  ☆1,164Updated last year
• PeaBrane / mamba-tiny
  Simple, minimal implementation of the Mamba SSM in one pytorch file. Using logcumsumexp (Heisen sequence).
  ☆130Updated last year
• AkiRusProd / numpy-transformer
  A numpy implementation of the Transformer model in "Attention is All You Need"
  ☆58Updated last year
• kyegomez / Jamba
  PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"
  ☆206Updated 3 weeks ago
• SynodicMonth / ChebyKAN
  Kolmogorov-Arnold Networks (KAN) using Chebyshev polynomials instead of B-splines.
  ☆402Updated last year
• junfanz1 / MoE-Mixture-of-Experts-in-PyTorch
  Implementations of a Mixture-of-Experts (MoE) architecture designed for research on large language models (LLMs) and scalable neural netw…
  ☆55Updated 10 months ago
• 1ssb / torchkan
  An easy to use PyTorch implementation of the Kolmogorov Arnold Network and a few novel variations
  ☆189Updated last year
• BrianPulfer / PapersReimplementations
  Personal short implementations of Machine Learning papers
  ☆252Updated 2 years ago
• priyammaz / PyTorch-Adventures
  This repository contains an exhaustive coverage of a hands on approach to PyTorch along side powerful tools to accelerate model tuning an…
  ☆226Updated last week
• arnav-jain1 / ml-from-scratch-in-C
  ☆62Updated last year
• lucasdelimanogueira / PyNorch
  Recreating PyTorch from scratch (C/C++, CUDA, NCCL and Python, with multi-GPU support and automatic differentiation!)
  ☆162Updated 2 months ago
• Indoxer / LKAN
  Variations of Kolmogorov-Arnold Networks
  ☆116Updated last year
• maciejbalawejder / Deep-Learning-Collection
  ☆64Updated 3 years ago
• aykutcayir34 / DifferentialTransformer
  ☆13Updated last year
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆93Updated last year
• pg2455 / KAN-Tutorial
  Understanding Kolmogorov-Arnold Networks: A Tutorial Series on KAN using Toy Examples
  ☆204Updated 8 months ago
• antonio-f / mixture-of-experts-from-scratch
  Mixture of Experts from scratch
  ☆12Updated last year
• floriankark / cs224n-win2223
  Code and written solutions of the assignments of the Stanford CS224N: Natural Language Processing with Deep Learning course from winter 2…
  ☆269Updated last year
• evintunador / minLlama3
  a simplified version of Meta's Llama 3 model to be used for learning
  ☆44Updated last year
• atakansite / nlp-courses
  Natural Language Processing Courses with Resources
  ☆42Updated 4 months ago
• Subhajit135 / CS236_DGM
  🦍 Stanford CS236 : Deep Generative Models
  ☆158Updated 7 years ago
• hkproj / quantization-notes
  Notes on quantization in neural networks
  ☆117Updated 2 years ago