Alternatives and similar repositories for transformers:

Users that are interested in transformers are comparing it to the libraries listed below

• microsoft / DeepSpeed
  DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
  ☆36,255Updated this week
• facebookresearch / fairseq
  Facebook AI Research Sequence-to-Sequence Toolkit written in Python.
  ☆30,809Updated last week
• google-research / bert
  TensorFlow code and pre-trained models for BERT
  ☆38,519Updated 5 months ago
• microsoft / unilm
  Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
  ☆20,584Updated last week
• Lightning-AI / pytorch-lightning
  Pretrain, finetune ANY AI model of ANY size on multiple GPUs, TPUs with zero code changes.
  ☆28,807Updated last week
• gradio-app / gradio
  Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!
  ☆35,268Updated this week
• karpathy / minGPT
  A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training
  ☆20,810Updated 5 months ago
• huggingface / peft
  🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
  ☆16,978Updated this week
• jessevig / bertviz
  BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)
  ☆7,075Updated last year
• huggingface / accelerate
  🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (i…
  ☆8,178Updated this week
• NVIDIA / Megatron-LM
  Ongoing research training transformer models at scale
  ☆11,109Updated this week
• huggingface / datasets
  🤗 The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools
  ☆19,461Updated this week
• jax-ml / jax
  Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more
  ☆30,985Updated this week
• google / sentencepiece
  Unsupervised text tokenizer for Neural Network-based text generation.
  ☆10,479Updated last month
• UKPLab / sentence-transformers
  State-of-the-Art Text Embeddings
  ☆15,772Updated last week
• facebookresearch / faiss
  A library for efficient similarity search and clustering of dense vectors.
  ☆32,387Updated this week
• huggingface / diffusers
  🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch and FLAX.
  ☆27,123Updated this week
• NVIDIA / DeepLearningExamples
  State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reproducible accuracy and performance on enter…
  ☆13,831Updated 5 months ago
• tensorflow / tensor2tensor
  Library of deep learning models and datasets designed to make deep learning more accessible and accelerate ML research.
  ☆15,740Updated last year
• openai / CLIP
  CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image
  ☆26,971Updated 5 months ago
• karpathy / nanoGPT
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆38,486Updated last month
• huggingface / tokenizers
  💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
  ☆9,258Updated this week
• huggingface / pytorch-image-models
  The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights --…
  ☆32,920Updated this week
• pytorch / pytorch
  Tensors and Dynamic neural networks in Python with strong GPU acceleration
  ☆85,920Updated this week
• meta-llama / llama
  Inference code for Llama models
  ☆57,227Updated 4 months ago
• harvardnlp / annotated-transformer
  An annotated implementation of the Transformer paper.
  ☆5,900Updated 9 months ago
• BlinkDL / RWKV-LM
  RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable)…
  ☆13,005Updated last week
• ggerganov / llama.cpp
  LLM inference in C/C++
  ☆70,826Updated this week
• microsoft / LoRA
  Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
  ☆11,119Updated last month
• openai / whisper
  Robust Speech Recognition via Large-Scale Weak Supervision
  ☆74,399Updated last week