Alternatives and similar repositories for tiger

Users that are interested in tiger are comparing it to the libraries listed below

• bojone / tiger
  A Tight-fisted Optimizer
  ☆50Updated 2 years ago
• nengwp / Lion-vs-Adam
  Lion and Adam optimization comparison
  ☆63Updated 2 years ago
• ZhuiyiTechnology / GAU-alpha
  基于Gated Attention Unit的Transformer模型（尝鲜版）
  ☆98Updated 2 years ago
• DRSY / EMO
  [ICLR 2024]EMO: Earth Mover Distance Optimization for Auto-Regressive Language Modeling(https://arxiv.org/abs/2310.04691)
  ☆124Updated last year
• cofe-ai / Mu-scaling
  Research without Re-search: Maximal Update Parametrization Yields Accurate Loss Prediction across Scales
  ☆32Updated 2 years ago
• thu-coai / TaiLr
  ICLR2023 - Tailoring Language Generation Models under Total Variation Distance
  ☆21Updated 2 years ago
• jiahe7ay / infini-mini-transformer
  This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…
  ☆58Updated last year
• HKUNLP / efficient-attention
  [EVA ICLR'23; LARA ICML'22] Efficient attention mechanisms via control variates, random features, and importance sampling
  ☆86Updated 2 years ago
• Academic-Hammer / HammerLLM
  1.4B sLLM for Chinese and English - HammerLLM🔨
  ☆44Updated last year
• NormXU / Consistent-DynamicNTKRoPE
  An Experiment on Dynamic NTK Scaling RoPE
  ☆64Updated last year
• OpenNLPLab / Transnormer
  [EMNLP 2022] Official implementation of Transnormer in our EMNLP 2022 paper - The Devil in Linear Transformer
  ☆62Updated 2 years ago
• wutaiqiang / LLM_KD_AKL
  ☆18Updated 10 months ago
• lxchtan / PoNet
  Official code for ICLR 2022 paper: "PoNet: Pooling Network for Efficient Token Mixing in Long Sequences".
  ☆33Updated 2 years ago
• JunnYu / FLASHQuad_pytorch
  FLASHQuad_pytorch
  ☆68Updated 3 years ago
• huawei-noah / Efficient-NLP
  ☆95Updated last year
• Namco0816 / PT-BERT
  ACL 2022(findings): A Sentence is Worth 128 Pseudo Tokens: A Semantic-Aware Contrastive Learning Framework for Sentence Embeddings
  ☆18Updated 3 years ago
• WhereIsAI / BiLLM
  Tool for converting LLMs from uni-directional to bi-directional by removing causal mask for tasks like classification and sentence embedd…
  ☆60Updated 8 months ago
• berlino / gated_linear_attention
  ☆106Updated last year
• SimiaoZuo / MoEBERT
  This PyTorch package implements MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation (NAACL 2022).
  ☆111Updated 3 years ago
• princeton-pli / MeCo
  Code for ICML 25 paper "Metadata Conditioning Accelerates Language Model Pre-training (MeCo)"
  ☆42Updated 2 months ago
• TianduoWang / DiffAug
  [EMNLP 2022] Differentiable Data Augmentation for Contrastive Sentence Representation Learning. https://arxiv.org/abs/2210.16536
  ☆40Updated 2 years ago
• DAMO-NLP-SG / CLEX
  [ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models
  ☆78Updated last year
• JunnYu / ChineseBert_pytorch
  huggingface ChineseBert Tokenizer
  ☆16Updated 3 years ago
• codefuse-ai / Collinear-Constrained-Attention
  ☆63Updated last year
• beyondguo / TrainingDynamics
  Compute training dynamics, plot data cartography, analysing data quality...
  ☆41Updated 2 years ago
• bojone / univae
  基于Transformer的单模型、多尺度的VAE模型
  ☆57Updated 4 years ago
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆54Updated 2 years ago
• ZhenweiAn / Dynamic_MoE
  Inference Code for Paper "Harder Tasks Need More Experts: Dynamic Routing in MoE Models"
  ☆60Updated last year
• juvi21 / CoPE-cuda
  Contextual Position Encoding but with some custom CUDA Kernels https://arxiv.org/abs/2405.18719
  ☆22Updated last year
• huiyegit / APLC_XLNet
  ☆19Updated 4 years ago