Alternatives and similar repositories for How-Transformers-Work

Users that are interested in How-Transformers-Work are comparing it to the libraries listed below

• coaxsoft / pytorch_bert
  Tutorial for how to build BERT from scratch
  ☆93Updated last year
• lucasdelimanogueira / PyNorch
  Recreating PyTorch from scratch (C/C++, CUDA, NCCL and Python, with multi-GPU support and automatic differentiation!)
  ☆151Updated last year
• aju22 / LLaMA2
  This repository contains an implementation of the LLaMA 2 (Large Language Model Meta AI) model, a Generative Pretrained Transformer (GPT)…
  ☆67Updated last year
• cindysridykhan / instruct_storyteller_tinyllama2
  Training and Fine-tuning an llm in Python and PyTorch.
  ☆42Updated last year
• hkproj / pytorch-llama
  LLaMA 2 implemented from scratch in PyTorch
  ☆329Updated last year
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆111Updated 8 months ago
• neubig / minllama-assignment
  ☆87Updated 8 months ago
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆68Updated last year
• keeeeenw / MicroLlama
  Micro Llama is a small Llama based model with 300M parameters trained from scratch with $500 budget
  ☆151Updated last year
• hkproj / rlhf-ppo
  Notes and commented code for RLHF (PPO)
  ☆96Updated last year
• pacman100 / openhathi_instruct
  This repository contains the code for dataset curation and finetuning of instruct variant of the Bilingual OpenHathi model. The resultin…
  ☆23Updated last year
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆147Updated 2 months ago
• mzbac / llama2-fine-tune
  Scripts for fine-tuning Llama2 via SFT and DPO.
  ☆200Updated last year
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆90Updated 2 months ago
• evintunador / minLlama3
  a simplified version of Meta's Llama 3 model to be used for learning
  ☆41Updated last year
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆77Updated 7 months ago
• AliHaiderAhmad001 / BERT-from-Scratch-with-PyTorch
  Implementation of BERT-based Language Models
  ☆19Updated last year
• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆204Updated last year
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆221Updated 7 months ago
• FareedKhan-dev / Building-llama3-from-scratch
  LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.
  ☆166Updated 9 months ago
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆104Updated last year
• hkproj / bert-from-scratch
  BERT explained from scratch
  ☆13Updated last year
• melisa-writer / short-transformers
  Prune transformer layers
  ☆69Updated last year
• nlp-uoregon / Okapi
  Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback
  ☆96Updated last year
• LLM360 / amber-train
  Pre-training code for Amber 7B LLM
  ☆166Updated last year
• ayulockin / neurips-llm-efficiency-challenge
  Starter pack for NeurIPS LLM Efficiency Challenge 2023.
  ☆122Updated last year
• FareedKhan-dev / create-million-parameter-llm-from-scratch
  Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.
  ☆170Updated last year
• hkproj / triton-flash-attention
  ☆169Updated 5 months ago
• ChanCheeKean / DataScience
  ☆83Updated last year
• FreedomIntelligence / MultilingualSIFT
  MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning
  ☆89Updated last year