Alternatives and similar repositories for transformer

Users that are interested in transformer are comparing it to the libraries listed below

• BlinkDL / nanoRWKV
  RWKV in nanoGPT style
  ☆197Updated last year
• VatsaDev / nanoChatGPT
  nanogpt turned into a chat model
  ☆81Updated 2 years ago
• Andrei-Aksionov / nanoGPTplus
  ☆53Updated last year
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆68Updated last year
• keeeeenw / MicroLlama
  Micro Llama is a small Llama based model with 300M parameters trained from scratch with $500 budget
  ☆169Updated 5 months ago
• ethanyanjiali / minChatGPT
  A minimum example of aligning language models with RLHF similar to ChatGPT
  ☆225Updated 2 years ago
• cindysridykhan / instruct_storyteller_tinyllama2
  Training and Fine-tuning an llm in Python and PyTorch.
  ☆43Updated 2 years ago
• SeanNaren / min-LLM
  Minimal code to train a Large Language Model (LLM).
  ☆170Updated 3 years ago
• johnma2006 / candle
  Deep learning library implemented from scratch in numpy. Mixtral, Mamba, LLaMA, GPT, ResNet, and other experiments.
  ☆53Updated last year
• broskicodes / slms
  Experimenting with small language models
  ☆76Updated 2 years ago
• leloykun / llama2.cpp
  Inference Llama 2 in one file of pure C++
  ☆87Updated 2 years ago
• haocai1992 / GPT2-News-Classifier
  A Streamlit app running GPT-2 language model for text classification, built with Pytorch, Transformers and AWS SageMaker.
  ☆39Updated 4 years ago
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆77Updated last year
• uygarkurt / Llama-3-PyTorch
  ☆42Updated last year
• wozeparrot / tinyrwkv
  tinygrad port of the RWKV large language model.
  ☆45Updated 10 months ago
• geronimi73 / qlora-minimal
  ☆88Updated 2 years ago
• hunar4321 / reweight-gpt
  Reweight GPT - a simple neural network using transformer architecture for next character prediction
  ☆57Updated 2 years ago
• jaymody / picoBERT
  Like picoGPT but for BERT.
  ☆51Updated 2 years ago
• jsbaan / transformer-from-scratch
  Well documented, unit tested, type checked and formatted implementation of a vanilla transformer - for educational purposes.
  ☆282Updated last year
• geronimi73 / 3090_shorts
  minimal scripts for 24GB VRAM GPUs. training, inference, whatever
  ☆50Updated last month
• geronimi73 / phi2-finetune
  ☆86Updated 2 years ago
• uygarkurt / BERT-PyTorch
  ☆17Updated last year
• akjindal53244 / Arithmo
  Small and Efficient Mathematical Reasoning LLMs
  ☆73Updated 2 years ago
• LLM360 / crystalcoder-train
  Pre-training code for CrystalCoder 7B LLM
  ☆57Updated last year
• danielgrittner / nanoGPT-LoRA
  The simplest, fastest repository for training/finetuning medium-sized GPTs with LoRA support.
  ☆29Updated last year
• mlabonne / chessllm
  ☆42Updated 2 years ago
• randaller / llama-cpu
  Inference on CPU code for LLaMA models
  ☆137Updated 2 years ago
• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆122Updated 2 years ago
• eduardoleao052 / Autograd-from-scratch
  Documented and Unit Tested educational Deep Learning framework with Autograd from scratch.
  ☆122Updated last year
• togethercomputer / Llama-2-7B-32K-Instruct
  ☆84Updated 2 years ago