Alternatives and similar repositories for pytorch_bert:

Users that are interested in pytorch_bert are comparing it to the libraries listed below

• hkproj / pytorch-llama
  LLaMA 2 implemented from scratch in PyTorch
  ☆294Updated last year
• jsbaan / transformer-from-scratch
  Well documented, unit tested, type checked and formatted implementation of a vanilla transformer - for educational purposes.
  ☆236Updated 10 months ago
• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆94Updated last year
• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆196Updated 11 months ago
• hkproj / rlhf-ppo
  Notes and commented code for RLHF (PPO)
  ☆69Updated 11 months ago
• thomfoster / minRLHF
  A (somewhat) minimal library for finetuning language models with PPO on human feedback.
  ☆86Updated 2 years ago
• ChanCheeKean / DataScience
  ☆78Updated 10 months ago
• tintn / vision-transformer-from-scratch
  A Simplified PyTorch Implementation of Vision Transformer (ViT)
  ☆162Updated 8 months ago
• hkproj / triton-flash-attention
  ☆128Updated last month
• aju22 / LLaMA2
  This repository contains an implementation of the LLaMA 2 (Large Language Model Meta AI) model, a Generative Pretrained Transformer (GPT)…
  ☆60Updated last year
• ethanyanjiali / minChatGPT
  A minimum example of aligning language models with RLHF similar to ChatGPT
  ☆217Updated last year
• bkitano / llama-from-scratch
  Llama from scratch, or How to implement a paper without crying
  ☆542Updated 8 months ago
• lucidrains / CALM-pytorch
  Implementation of CALM from the paper "LLM Augmented LLMs: Expanding Capabilities through Composition", out of Google Deepmind
  ☆173Updated 5 months ago
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆53Updated 10 months ago
• HumanSignal / RLHF
  Collection of links, tutorials and best practices of how to collect the data and build end-to-end RLHF system to finetune Generative AI m…
  ☆214Updated last year
• kyleliang919 / Long-context-transformers
  Exploring finetuning public checkpoints on filter 8K sequences on Pile
  ☆115Updated last year
• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆47Updated 8 months ago
• melisa-writer / short-transformers
  Prune transformer layers
  ☆67Updated 8 months ago
• neubig / minllama-assignment
  ☆80Updated 4 months ago
• bentrevett / a-tour-of-pytorch-optimizers
  A tour of different optimization algorithms in PyTorch.
  ☆95Updated 3 years ago
• knotgrass / How-Transformers-Work
  🧠 A study guide to learn about Transformers
  ☆10Updated last year
• lucidrains / pytorch-custom-utils
  Just some miscellaneous utility functions / decorators / modules related to Pytorch and Accelerate to help speed up implementation of new…
  ☆120Updated 6 months ago
• evintunador / minLlama3
  a simplified version of Meta's Llama 3 model to be used for learning
  ☆39Updated 8 months ago
• booydar / LM-RMT
  Recurrent Memory Transformer
  ☆149Updated last year
• rasbt / faster-pytorch-blog
  Outlining techniques for improving the training performance of your PyTorch model without compromising its accuracy
  ☆127Updated last year
• OlgaChernytska / word2vec-pytorch
  Implementation of the first paper on word2vec
  ☆212Updated 3 years ago
• fkodom / grouped-query-attention-pytorch
  (Unofficial) PyTorch implementation of grouped-query attention (GQA) from "GQA: Training Generalized Multi-Query Transformer Models from …
  ☆151Updated 9 months ago
• lucidrains / st-moe-pytorch
  Implementation of ST-Moe, the latest incarnation of MoE after years of research at Brain, in Pytorch
  ☆306Updated 8 months ago
• uygarkurt / BERT-PyTorch
  ☆16Updated last month