coaxsoft / pytorch_bert

Related projects: ⓘ

• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆179Updated 6 months ago
• hkproj / pytorch-llama
  LLaMA 2 implemented from scratch in PyTorch
  ☆216Updated 11 months ago
• suicao / ai4code-baseline
  Early solution for Google AI4Code competition
  ☆75Updated 2 years ago
• huggingface / large_language_model_training_playbook
  An open collection of implementation tips, tricks and resources for training large language models
  ☆455Updated last year
• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆72Updated last year
• ccdv-ai / convert_checkpoint_to_lsg
  Efficient Attention for Long Sequence Processing
  ☆84Updated 9 months ago
• llm-efficiency-challenge / neurips_llm_efficiency_challenge
  NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
  ☆248Updated 10 months ago
• fkodom / transformer-from-scratch
  Code implementation from my blog post: https://fkodom.substack.com/p/transformers-from-scratch-in-pytorch
  ☆90Updated last year
• jsbaan / transformer-from-scratch
  Well documented, unit tested, type checked and formatted implementation of a vanilla transformer - for educational purposes.
  ☆211Updated 5 months ago
• tintn / vision-transformer-from-scratch
  A Simplified PyTorch Implementation of Vision Transformer (ViT)
  ☆123Updated 3 months ago
• melisa-writer / short-transformers
  Prune transformer layers
  ☆60Updated 3 months ago
• rasbt / pytorch-memory-optim
  This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…
  ☆84Updated last year
• booydar / LM-RMT
  Recurrent Memory Transformer
  ☆148Updated last year
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆89Updated last week
• lucidrains / CALM-pytorch
  Implementation of CALM from the paper "LLM Augmented LLMs: Expanding Capabilities through Composition", out of Google Deepmind
  ☆161Updated last week
• kyleliang919 / Long-context-transformers
  Exploring finetuning public checkpoints on filter 8K sequences on Pile
  ☆115Updated last year
• knotgrass / How-Transformers-Work
  🧠 A study guide to learn about Transformers
  ☆10Updated 8 months ago
• lucidrains / st-moe-pytorch
  Implementation of ST-Moe, the latest incarnation of MoE after years of research at Brain, in Pytorch
  ☆278Updated 3 months ago
• lucidrains / CoLT5-attention
  Implementation of the conditionally routed attention in the CoLT5 architecture, in Pytorch
  ☆222Updated 2 weeks ago
• patrickvonplaten / notebooks
  Some notebooks for NLP
  ☆186Updated 10 months ago
• nlp-uoregon / Okapi
  Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback
  ☆89Updated last year
• Shivanandroy / T5-Finetuning-PyTorch
  Fine tune a T5 transformer model using PyTorch & Transformers🤗
  ☆192Updated 3 years ago
• facebookresearch / mega
  Sequence modeling with Mega.
  ☆296Updated last year
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆36Updated 5 months ago
• edumunozsala / RoBERTa_Encoder_Decoder_Product_Names
  Define Transformers, T5 model and RoBERTa Encoder decoder model for product names generation
  ☆47Updated 2 years ago
• aju22 / LLaMA2
  This repository contains an implementation of the LLaMA 2 (Large Language Model Meta AI) model, a Generative Pretrained Transformer (GPT)…
  ☆47Updated 11 months ago
• evintunador / minLlama3
  a simplified version of Meta's Llama 3 model to be used for learning
  ☆26Updated 3 months ago
• lucidrains / electra-pytorch
  A simple and working implementation of Electra, the fastest way to pretrain language models from scratch, in Pytorch
  ☆222Updated last year
• pacman100 / LLM-Workshop
  LLM Workshop by Sourab Mangrulkar
  ☆322Updated 3 months ago
• OlgaChernytska / word2vec-pytorch
  Implementation of the first paper on word2vec
  ☆196Updated 2 years ago