Alternatives and similar repositories for transformers

Users that are interested in transformers are comparing it to the libraries listed below

• google-research / bert
  TensorFlow code and pre-trained models for BERT
  ☆39,558Updated last year
• Lightning-AI / pytorch-lightning
  Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.
  ☆30,222Updated this week
• gradio-app / gradio
  Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!
  ☆40,109Updated this week
• google-research / google-research
  Google Research
  ☆36,469Updated this week
• huggingface / diffusers
  🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.
  ☆30,995Updated this week
• facebookresearch / fairseq
  Facebook AI Research Sequence-to-Sequence Toolkit written in Python.
  ☆31,856Updated last week
• huggingface / peft
  🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
  ☆19,743Updated this week
• microsoft / unilm
  Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
  ☆21,753Updated 3 months ago
• huggingface / datasets
  🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools
  ☆20,711Updated last week
• karpathy / minGPT
  A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training
  ☆22,669Updated last year
• deepspeedai / DeepSpeed
  DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
  ☆40,325Updated this week
• pytorch / pytorch
  Tensors and Dynamic neural networks in Python with strong GPU acceleration
  ☆93,636Updated last week
• openai / CLIP
  CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image
  ☆30,921Updated last year
• meta-llama / llama
  Inference code for Llama models
  ☆58,786Updated 8 months ago
• google / sentencepiece
  Unsupervised text tokenizer for Neural Network-based text generation.
  ☆11,331Updated this week
• huggingface / tokenizers
  💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
  ☆10,114Updated 2 weeks ago
• facebookresearch / faiss
  A library for efficient similarity search and clustering of dense vectors.
  ☆37,368Updated this week
• NVIDIA / Megatron-LM
  Ongoing research training transformer models at scale
  ☆13,755Updated this week
• jessevig / bertviz
  BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)
  ☆7,686Updated 4 months ago
• ggml-org / llama.cpp
  LLM inference in C/C++
  ☆87,149Updated last week
• Dao-AILab / flash-attention
  Fast and memory-efficient exact attention
  ☆19,778Updated last week
• UKPLab / sentence-transformers
  State-of-the-Art Text Embeddings
  ☆17,649Updated this week
• huggingface / accelerate
  🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (i…
  ☆9,180Updated last week
• huggingface / trl
  Train transformer language models with reinforcement learning.
  ☆15,739Updated this week
• tatsu-lab / stanford_alpaca
  Code and documentation to train Stanford's Alpaca models, and generate the data.
  ☆30,166Updated last year
• pytorch / examples
  A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.
  ☆23,439Updated last month
• hpcaitech / ColossalAI
  Making large AI models cheaper, faster and more accessible
  ☆41,191Updated last week
• karpathy / nanoGPT
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆44,823Updated 9 months ago
• facebookresearch / detectron2
  Detectron2 is a platform for object detection, segmentation and other visual recognition tasks.
  ☆33,434Updated last month
• streamlit / streamlit
  Streamlit — A faster way to build and share data apps.
  ☆41,651Updated this week