Alternatives and similar repositories for pytorch_bert:

Users that are interested in pytorch_bert are comparing it to the libraries listed below

• jsbaan / transformer-from-scratch
  Well documented, unit tested, type checked and formatted implementation of a vanilla transformer - for educational purposes.
  ☆244Updated last year
• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆102Updated last year
• knotgrass / How-Transformers-Work
  🧠 A study guide to learn about Transformers
  ☆11Updated last year
• ChanCheeKean / DataScience
  ☆82Updated last year
• philschmid / knowledge-distillation-transformers-pytorch-sagemaker
  ☆46Updated 3 years ago
• AliHaiderAhmad001 / BERT-from-Scratch-with-PyTorch
  Implementation of BERT-based Language Models
  ☆19Updated last year
• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆203Updated last year
• edumunozsala / RoBERTa_Encoder_Decoder_Product_Names
  Define Transformers, T5 model and RoBERTa Encoder decoder model for product names generation
  ☆48Updated 3 years ago
• hkproj / pytorch-llama
  LLaMA 2 implemented from scratch in PyTorch
  ☆323Updated last year
• hkproj / rlhf-ppo
  Notes and commented code for RLHF (PPO)
  ☆90Updated last year
• aju22 / LLaMA2
  This repository contains an implementation of the LLaMA 2 (Large Language Model Meta AI) model, a Generative Pretrained Transformer (GPT)…
  ☆65Updated last year
• tintn / vision-transformer-from-scratch
  A Simplified PyTorch Implementation of Vision Transformer (ViT)
  ☆182Updated 10 months ago
• HumanSignal / RLHF
  Collection of links, tutorials and best practices of how to collect the data and build end-to-end RLHF system to finetune Generative AI m…
  ☆220Updated last year
• lucidrains / st-moe-pytorch
  Implementation of ST-Moe, the latest incarnation of MoE after years of research at Brain, in Pytorch
  ☆328Updated 10 months ago
• rasbt / pytorch-memory-optim
  This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…
  ☆92Updated last year
• ajhalthor / Transformer-Neural-Network
  Code Transformer neural network components piece by piece
  ☆343Updated 2 years ago
• ayulockin / neurips-llm-efficiency-challenge
  Starter pack for NeurIPS LLM Efficiency Challenge 2023.
  ☆124Updated last year
• thomfoster / minRLHF
  A (somewhat) minimal library for finetuning language models with PPO on human feedback.
  ☆85Updated 2 years ago
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆108Updated 7 months ago
• booydar / LM-RMT
  Recurrent Memory Transformer
  ☆149Updated last year
• hkproj / triton-flash-attention
  ☆159Updated 4 months ago
• ethanyanjiali / minChatGPT
  A minimum example of aligning language models with RLHF similar to ChatGPT
  ☆217Updated last year
• Shivanandroy / T5-Finetuning-PyTorch
  Fine tune a T5 transformer model using PyTorch & Transformers🤗
  ☆212Updated 4 years ago
• bigscience-workshop / lm-evaluation-harness
  A framework for few-shot evaluation of autoregressive language models.
  ☆103Updated 2 years ago
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆66Updated last year
• Khaliladib11 / Transformer-from-scratch
  I will build Transformer from scratch
  ☆68Updated 11 months ago
• xrsrke / instructGOOSE
  Implementation of Reinforcement Learning from Human Feedback (RLHF)
  ☆173Updated 2 years ago
• rasbt / faster-pytorch-blog
  Outlining techniques for improving the training performance of your PyTorch model without compromising its accuracy
  ☆129Updated 2 years ago
• 0xallam / Direct-Preference-Optimization
  Direct Preference Optimization from scratch in PyTorch
  ☆91Updated last month
• alexriggio / BERT-LoRA-TensorRT
  This repository contains a custom implementation of the BERT model, fine-tuned for specific tasks, along with an implementation of Low Ra…
  ☆72Updated last year