Alternatives and similar repositories for tiger

Users that are interested in tiger are comparing it to the libraries listed below

• bojone / tiger
  A Tight-fisted Optimizer
  ☆50Updated 2 years ago
• nengwp / Lion-vs-Adam
  Lion and Adam optimization comparison
  ☆64Updated 2 years ago
• DRSY / EMO
  [ICLR 2024]EMO: Earth Mover Distance Optimization for Auto-Regressive Language Modeling(https://arxiv.org/abs/2310.04691)
  ☆128Updated last year
• ZhuiyiTechnology / GAU-alpha
  基于Gated Attention Unit的Transformer模型（尝鲜版）
  ☆98Updated 2 years ago
• OpenNLPLab / Transnormer
  [EMNLP 2022] Official implementation of Transnormer in our EMNLP 2022 paper - The Devil in Linear Transformer
  ☆64Updated 2 years ago
• cofe-ai / Mu-scaling
  Research without Re-search: Maximal Update Parametrization Yields Accurate Loss Prediction across Scales
  ☆32Updated 2 years ago
• HKUNLP / efficient-attention
  [EVA ICLR'23; LARA ICML'22] Efficient attention mechanisms via control variates, random features, and importance sampling
  ☆87Updated 2 years ago
• thu-coai / TaiLr
  ICLR2023 - Tailoring Language Generation Models under Total Variation Distance
  ☆21Updated 2 years ago
• jiahe7ay / infini-mini-transformer
  This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…
  ☆58Updated last year
• JunnYu / FLASHQuad_pytorch
  FLASHQuad_pytorch
  ☆68Updated 3 years ago
• berlino / gated_linear_attention
  ☆107Updated last year
• NormXU / Consistent-DynamicNTKRoPE
  An Experiment on Dynamic NTK Scaling RoPE
  ☆64Updated 2 years ago
• lxchtan / PoNet
  Official code for ICLR 2022 paper: "PoNet: Pooling Network for Efficient Token Mixing in Long Sequences".
  ☆33Updated 2 years ago
• bojone / univae
  基于Transformer的单模型、多尺度的VAE模型
  ☆58Updated 4 years ago
• WailordHe / DenseSSM
  A repository for DenseSSMs
  ☆88Updated last year
• JunnYu / ChineseBert_pytorch
  huggingface ChineseBert Tokenizer
  ☆16Updated 3 years ago
• TianduoWang / DiffAug
  [EMNLP 2022] Differentiable Data Augmentation for Contrastive Sentence Representation Learning. https://arxiv.org/abs/2210.16536
  ☆40Updated 3 years ago
• Caiyun-AI / MUDDFormer
  ☆90Updated 8 months ago
• wutaiqiang / LLM_KD_AKL
  ☆22Updated last year
• Academic-Hammer / HammerLLM
  1.4B sLLM for Chinese and English - HammerLLM🔨
  ☆43Updated last year
• SimiaoZuo / MoEBERT
  This PyTorch package implements MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation (NAACL 2022).
  ☆112Updated 3 years ago
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆56Updated 2 years ago
• DAMO-NLP-SG / CLEX
  [ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models
  ☆78Updated last year
• piotrpiekos / MoSA
  User-friendly implementation of the Mixture-of-Sparse-Attention (MoSA). MoSA selects distinct tokens for each head with expert choice rou…
  ☆28Updated 8 months ago
• transformer-vq / transformer_vq
  ☆201Updated 2 years ago
• juvi21 / CoPE-cuda
  Contextual Position Encoding but with some custom CUDA Kernels https://arxiv.org/abs/2405.18719
  ☆22Updated last year
• dashstander / block-recurrent-transformer
  Pytorch implementation of "Block Recurrent Transformers" (Hutchins & Schlag et al., 2022)
  ☆85Updated 3 years ago
• math-eval / aaai2024comp
  AAAI2024 Global Competition on Math Problem Solving and Reasoning
  ☆14Updated 2 years ago
• princeton-pli / MeCo
  Code for ICML 25 paper "Metadata Conditioning Accelerates Language Model Pre-training (MeCo)"
  ☆49Updated 6 months ago
• Qznan / SpanKL
  Code for paper: A Neural Span-Based Continual Named Entity Recognition Model
  ☆18Updated 2 years ago