Alternatives and similar repositories for How-Transformers-Work

Users that are interested in How-Transformers-Work are comparing it to the libraries listed below

• coaxsoft / pytorch_bert
  Tutorial for how to build BERT from scratch
  ☆99Updated last year
• hkproj / pytorch-llama
  LLaMA 2 implemented from scratch in PyTorch
  ☆358Updated 2 years ago
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆202Updated 7 months ago
• pacman100 / LLM-Workshop
  LLM Workshop by Sourab Mangrulkar
  ☆394Updated last year
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆110Updated last year
• bkitano / llama-from-scratch
  Llama from scratch, or How to implement a paper without crying
  ☆579Updated last year
• aju22 / LLaMA2
  This repository contains an implementation of the LLaMA 2 (Large Language Model Meta AI) model, a Generative Pretrained Transformer (GPT)…
  ☆72Updated 2 years ago
• hkproj / pytorch-llama-notes
  Notes about LLaMA 2 model
  ☆68Updated 2 years ago
• lucasdelimanogueira / PyNorch
  Recreating PyTorch from scratch (C/C++, CUDA, NCCL and Python, with multi-GPU support and automatic differentiation!)
  ☆160Updated last year
• jsbaan / transformer-from-scratch
  Well documented, unit tested, type checked and formatted implementation of a vanilla transformer - for educational purposes.
  ☆265Updated last year
• huggingface / picotron_tutorial
  ☆224Updated last week
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆85Updated last year
• ymoslem / Adaptive-MT-LLM-Fine-tuning
  Fine-tuning Open-Source LLMs for Adaptive Machine Translation
  ☆87Updated 3 months ago
• NVIDIA / logits-processor-zoo
  A collection of LogitsProcessors to customize and enhance LLM behavior for specific tasks.
  ☆369Updated 3 months ago
• melisa-writer / short-transformers
  Prune transformer layers
  ☆69Updated last year
• neubig / minllama-assignment
  ☆98Updated last year
• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆211Updated last year
• facebookresearch / belebele
  Repo for the Belebele dataset, a massively multilingual reading comprehension dataset.
  ☆335Updated 10 months ago
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆193Updated 4 months ago
• FranxYao / Long-Context-Data-Engineering
  Implementation of paper Data Engineering for Scaling Language Models to 128K Context
  ☆477Updated last year
• hkproj / triton-flash-attention
  ☆209Updated 9 months ago
• Locutusque / TPU-Alignment
  Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free
  ☆231Updated 11 months ago
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆240Updated 11 months ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆273Updated last year
• huggingface / text-clustering
  Easily embed, cluster and semantically label text datasets
  ☆581Updated last year
• Pints-AI / 1.5-Pints
  A compact LLM pretrained in 9 days by using high quality data
  ☆330Updated 6 months ago
• yuhuixu1993 / qa-lora
  Official PyTorch implementation of QA-LoRA
  ☆141Updated last year
• s-smits / modernbert-finetune
  Fine-tune ModernBERT on a large Dataset with Custom Tokenizer Training
  ☆73Updated last week
• imoneoi / multipack
  Multipack distributed sampler for fast padding-free training of LLMs
  ☆201Updated last year
• llm-efficiency-challenge / neurips_llm_efficiency_challenge
  NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
  ☆256Updated 2 years ago