Alternatives and similar repositories for transformer

Users that are interested in transformer are comparing it to the libraries listed below

• VatsaDev / nanoChatGPT
  nanogpt turned into a chat model
  ☆80Updated 2 years ago
• hunar4321 / reweight-gpt
  Reweight GPT - a simple neural network using transformer architecture for next character prediction
  ☆57Updated 2 years ago
• cindysridykhan / instruct_storyteller_tinyllama2
  Training and Fine-tuning an llm in Python and PyTorch.
  ☆43Updated 2 years ago
• Oxen-AI / mamba-dive
  This is the code that went into our practical dive using mamba as information extraction
  ☆57Updated 2 years ago
• BlinkDL / nanoRWKV
  RWKV in nanoGPT style
  ☆197Updated last year
• chai-research / lmgym
  Code base for internal reward models and PPO training
  ☆24Updated 2 years ago
• Jellyfish042 / Sudoku-RWKV
  ☆148Updated last year
• uygarkurt / Llama-3-PyTorch
  ☆41Updated last year
• yurakuratov / t5-experiments
  Tools and scripts for experimenting with Transformers: Bert, T5...
  ☆61Updated 2 years ago
• keeeeenw / MicroLlama
  Micro Llama is a small Llama based model with 300M parameters trained from scratch with $500 budget
  ☆169Updated 5 months ago
• geronimi73 / phi2-finetune
  ☆86Updated 2 years ago
• ironbar / arc24
  Create an AI capable of solving reasoning tasks it has never seen before
  ☆96Updated last year
• KevlarKanou / rwkv7.c
  Inference RWKV v7 in pure C.
  ☆43Updated 3 months ago
• ethanyanjiali / minChatGPT
  A minimum example of aligning language models with RLHF similar to ChatGPT
  ☆225Updated 2 years ago
• FareedKhan-dev / Building-llama3-from-scratch
  LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.
  ☆197Updated last year
• ragntune / code-llama-finetune
  ☆65Updated 2 years ago
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆68Updated last year
• broskicodes / slms
  Experimenting with small language models
  ☆76Updated 2 years ago
• adiekaye / very-simple-vector-database
  A Very Simple Vector Database
  ☆15Updated 2 years ago
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆77Updated last year
• vithursant / nanoGPT_mlx
  Port of Andrej Karpathy's nanoGPT to Apple MLX framework.
  ☆117Updated last year
• LLM360 / crystalcoder-train
  Pre-training code for CrystalCoder 7B LLM
  ☆57Updated last year
• qdrant / bm42_eval
  Evaluation of bm42 sparse indexing algorithm
  ☆72Updated last year
• kroggen / mamba.c
  Inference of Mamba and Mamba2 models in pure C
  ☆196Updated last week
• SeanNaren / min-LLM
  Minimal code to train a Large Language Model (LLM).
  ☆170Updated 3 years ago
• geronimi73 / mamba
  ☆31Updated 2 years ago
• jadechip / nanoXLSTM
  The simplest, fastest repository for training/finetuning medium-sized xLSTMs.
  ☆41Updated last year
• TianyiPeng / Colab_for_Alpaca_Lora
  Here is a Google Colab Notebook for fine-tuning Alpaca Lora (within 3 hours with a 40GB A100 GPU)
  ☆38Updated 2 years ago
• pranavjad / tinyllama-bitnet
  Train your own small bitnet model
  ☆77Updated last year
• joey00072 / Tinytorch
  A really tiny autograd engine
  ☆99Updated 8 months ago