Alternatives and similar repositories for BERT-PyTorch

Users that are interested in BERT-PyTorch are comparing it to the libraries listed below

• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆78Updated last year
• coaxsoft / pytorch_bert
  Tutorial for how to build BERT from scratch
  ☆101Updated last year
• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆119Updated 2 years ago
• VatsaDev / nanoChatGPT
  nanogpt turned into a chat model
  ☆80Updated 2 years ago
• rashmimarganiatgithub / LLMS_Library_2023
  LLM_library is a comprehensive repository serves as a one-stop resource hands-on code, insightful summaries.
  ☆69Updated 2 years ago
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆113Updated last year
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆90Updated last year
• Zefty / rag-end2end-retriever
  ☆20Updated 4 years ago
• hkproj / bert-from-scratch
  BERT explained from scratch
  ☆16Updated 2 years ago
• ymoslem / Adaptive-MT-LLM-Fine-tuning
  Fine-tuning Open-Source LLMs for Adaptive Machine Translation
  ☆90Updated 6 months ago
• melisa-writer / short-transformers
  Prune transformer layers
  ☆74Updated last year
• aju22 / LLaMA2
  This repository contains an implementation of the LLaMA 2 (Large Language Model Meta AI) model, a Generative Pretrained Transformer (GPT)…
  ☆74Updated 2 years ago
• alperiox / Compact-Language-Models-via-Pruning-and-Knowledge-Distillation
  Unofficial implementation of https://arxiv.org/pdf/2407.14679
  ☆53Updated last year
• FareedKhan-dev / create-million-parameter-llm-from-scratch
  Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.
  ☆195Updated last year
• cindysridykhan / instruct_storyteller_tinyllama2
  Training and Fine-tuning an llm in Python and PyTorch.
  ☆43Updated 2 years ago
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆244Updated last year
• HySonLab / ViDeBERTa
  ViDeBERTa: A powerful pre-trained language model for Vietnamese, EACL 2023
  ☆58Updated 2 years ago
• Abonia1 / Fine-Tuning-LLMs-Key-Concepts-and-Terms
  Fine-tuning large language models (LLMs) is crucial for enhancing performance across domain-specific task applications. This comprehensiv…
  ☆12Updated last year
• shreydan / VisionGPT2
  Combining ViT and GPT-2 for image captioning. Trained on MS-COCO. The model was implemented mostly from scratch.
  ☆48Updated 2 years ago
• nyunAI / Faster-LLM-Survey
  ☆42Updated last year
• mallik3006 / LLM_fine_tuning_llama3_8b
  Fine-Tuning Llama3-8B LLM in a multi-GPU environment using DeepSpeed
  ☆18Updated last year
• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆32Updated 3 months ago
• aymeric-roucher / benchmark_agents
  ☆27Updated last year
• akjindal53244 / Arithmo
  Small and Efficient Mathematical Reasoning LLMs
  ☆73Updated last year
• nlp-uoregon / Okapi
  Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback
  ☆96Updated 2 years ago
• ytyz1307zzh / RefAug
  Code for EMNLP 2024 paper "Learn Beyond The Answer: Training Language Models with Reflection for Mathematical Reasoning"
  ☆55Updated last year
• FareedKhan-dev / Building-llama3-from-scratch
  LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.
  ☆195Updated last year
• Montinger / Transformer-Workbench
  Playground for Transformers
  ☆53Updated 2 years ago
• knotgrass / attention
  several types of attention modules written in PyTorch for learning purposes
  ☆52Updated last week
• swj0419 / detect-pretrain-code-contamination
  ☆78Updated 2 years ago