BlinkDL / minGPT-tuned

Related projects ⓘ

Alternatives and complementary repositories for minGPT-tuned

• ZhuiyiTechnology / GAU-alpha
  基于Gated Attention Unit的Transformer模型（尝鲜版）
  ☆97Updated last year
• bojone / univae
  基于Transformer的单模型、多尺度的VAE模型
  ☆53Updated 3 years ago
• lucidrains / memory-compressed-attention
  Implementation of Memory-Compressed Attention, from the paper "Generating Wikipedia By Summarizing Long Sequences"
  ☆71Updated last year
• JunnYu / FLASHQuad_pytorch
  FLASHQuad_pytorch
  ☆66Updated 2 years ago
• lucidrains / axial-positional-embedding
  Axial Positional Embedding for Pytorch
  ☆60Updated 3 years ago
• wuch15 / Fastformer
  A pytorch &keras implementation and demo of Fastformer.
  ☆187Updated 2 years ago
• ShannonAI / GNN-LM
  ☆45Updated 2 years ago
• lucidrains / memformer
  Implementation of Memformer, a Memory-augmented Transformer, in Pytorch
  ☆106Updated 4 years ago
• lxchtan / PoNet
  Official code for ICLR 2022 paper: "PoNet: Pooling Network for Efficient Token Mixing in Long Sequences".
  ☆31Updated last year
• lucidrains / distilled-retriever-pytorch
  Implementation of the retriever distillation procedure as outlined in the paper "Distilling Knowledge from Reader to Retriever"
  ☆32Updated 3 years ago
• thu-coai / TaiLr
  ICLR2023 - Tailoring Language Generation Models under Total Variation Distance
  ☆21Updated last year
• princeton-nlp / DinkyTrain
  Princeton NLP's pre-training library based on fairseq with DeepSpeed kernel integration 🚃
  ☆112Updated 2 years ago
• 10-zin / Synthesizer
  A PyTorch implementation of the paper - "Synthesizer: Rethinking Self-Attention in Transformer Models"
  ☆71Updated last year
• laiguokun / Funnel-Transformer
  ☆212Updated 4 years ago
• lucidrains / long-short-transformer
  Implementation of Long-Short Transformer, combining local and global inductive biases for attention over long sequences, in Pytorch
  ☆116Updated 3 years ago
• lucidrains / coco-lm-pytorch
  Implementation of COCO-LM, Correcting and Contrasting Text Sequences for Language Model Pretraining, in Pytorch
  ☆45Updated 3 years ago
• FreedomIntelligence / complex-order
  ☆83Updated 5 years ago
• DeadAt0m / adafactor-pytorch
  A pytorch realization of adafactor (https://arxiv.org/pdf/1804.04235.pdf )
  ☆24Updated 5 years ago
• DRSY / EMO
  [ICLR 2024]EMO: Earth Mover Distance Optimization for Auto-Regressive Language Modeling(https://arxiv.org/abs/2310.04691)
  ☆114Updated 8 months ago
• OpenNLPLab / cosFormer
  [ICLR 2022] Official implementation of cosformer-attention in cosFormer: Rethinking Softmax in Attention
  ☆179Updated last year
• libeineu / ODE-Transformer
  This is a code repository for the ACL 2022 paper "ODE Transformer: An Ordinary Differential Equation-Inspired Model for Sequence Generati…
  ☆29Updated 2 years ago
• lucidrains / FLASH-pytorch
  Implementation of the Transformer variant proposed in "Transformer Quality in Linear Time"
  ☆350Updated last year
• twistedcubic / attention-rank-collapse
  [ICML 2021 Oral] We show pure attention suffers rank collapse, and how different mechanisms combat it.
  ☆162Updated 3 years ago
• sunyt32 / torchscale
  Transformers at any scale
  ☆41Updated 10 months ago
• neilfei / brivl-nmi
  ☆60Updated 2 years ago
• lucidrains / fast-transformer-pytorch
  Implementation of Fast Transformer in Pytorch
  ☆171Updated 3 years ago
• BAAI-WuDao / P-tuning
  Finetune CPM-1
  ☆24Updated 3 years ago
• bojone / LST-CLUE
  Ladder Side-Tuning在CLUE上的简单尝试
  ☆19Updated 2 years ago
• CyndxAI / QKNorm
  Code for the paper "Query-Key Normalization for Transformers"
  ☆35Updated 3 years ago