Alternatives and similar repositories for pytorch_bert:

Users that are interested in pytorch_bert are comparing it to the libraries listed below

• jsbaan / transformer-from-scratch
  Well documented, unit tested, type checked and formatted implementation of a vanilla transformer - for educational purposes.
  ☆239Updated 11 months ago
• thomfoster / minRLHF
  A (somewhat) minimal library for finetuning language models with PPO on human feedback.
  ☆85Updated 2 years ago
• ChanCheeKean / DataScience
  ☆80Updated last year
• hkproj / pytorch-llama
  LLaMA 2 implemented from scratch in PyTorch
  ☆307Updated last year
• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆99Updated last year
• mzbac / llama2-fine-tune
  Scripts for fine-tuning Llama2 via SFT and DPO.
  ☆195Updated last year
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆105Updated 6 months ago
• tintn / vision-transformer-from-scratch
  A Simplified PyTorch Implementation of Vision Transformer (ViT)
  ☆172Updated 9 months ago
• hkproj / rlhf-ppo
  Notes and commented code for RLHF (PPO)
  ☆77Updated last year
• HumanSignal / RLHF
  Collection of links, tutorials and best practices of how to collect the data and build end-to-end RLHF system to finetune Generative AI m…
  ☆216Updated last year
• uygarkurt / BERT-PyTorch
  ☆17Updated 2 months ago
• ethanyanjiali / minChatGPT
  A minimum example of aligning language models with RLHF similar to ChatGPT
  ☆217Updated last year
• Shivanandroy / T5-Finetuning-PyTorch
  Fine tune a T5 transformer model using PyTorch & Transformers🤗
  ☆209Updated 4 years ago
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆73Updated 5 months ago
• aju22 / LLaMA2
  This repository contains an implementation of the LLaMA 2 (Large Language Model Meta AI) model, a Generative Pretrained Transformer (GPT)…
  ☆63Updated last year
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆62Updated 11 months ago
• evintunador / minLlama3
  a simplified version of Meta's Llama 3 model to be used for learning
  ☆41Updated 10 months ago
• philschmid / knowledge-distillation-transformers-pytorch-sagemaker
  ☆45Updated 3 years ago
• booydar / babilong
  BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.
  ☆193Updated this week
• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆198Updated last year
• ajhalthor / Transformer-Neural-Network
  Code Transformer neural network components piece by piece
  ☆338Updated last year
• poteminr / instruct-ner
  Instruct LLMs for flat and nested NER. Fine-tuning Llama and Mistral models for instruction named entity recognition. (Instruction NER)
  ☆80Updated 10 months ago
• AkiRusProd / numpy-transformer
  A numpy implementation of the Transformer model in "Attention is All You Need"
  ☆54Updated 8 months ago
• Montinger / Transformer-Workbench
  Playground for Transformers
  ☆48Updated last year
• ccdv-ai / convert_checkpoint_to_lsg
  Efficient Attention for Long Sequence Processing
  ☆92Updated last year
• melisa-writer / short-transformers
  Prune transformer layers
  ☆68Updated 9 months ago
• Dahoas / reward-modeling
  ☆96Updated last year
• kyleliang919 / Long-context-transformers
  Exploring finetuning public checkpoints on filter 8K sequences on Pile
  ☆115Updated 2 years ago
• francoisstamant / lyrics-generation-with-GPT2
  ☆68Updated 2 years ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆253Updated 8 months ago