hazdzz / Tiger

Related projects ⓘ

Alternatives and complementary repositories for Tiger

• bojone / tiger
  A Tight-fisted Optimizer
  ☆47Updated last year
• nengwp / Lion-vs-Adam
  Lion and Adam optimization comparison
  ☆56Updated last year
• DRSY / EMO
  [ICLR 2024]EMO: Earth Mover Distance Optimization for Auto-Regressive Language Modeling(https://arxiv.org/abs/2310.04691)
  ☆114Updated 8 months ago
• cofe-ai / Mu-scaling
  Research without Re-search: Maximal Update Parametrization Yields Accurate Loss Prediction across Scales
  ☆30Updated last year
• thu-coai / TaiLr
  ICLR2023 - Tailoring Language Generation Models under Total Variation Distance
  ☆21Updated last year
• OpenNLPLab / Transnormer
  [EMNLP 2022] Official implementation of Transnormer in our EMNLP 2022 paper - The Devil in Linear Transformer
  ☆54Updated last year
• berlino / gated_linear_attention
  ☆97Updated 8 months ago
• ZhuiyiTechnology / GAU-alpha
  基于Gated Attention Unit的Transformer模型（尝鲜版）
  ☆96Updated last year
• HKUNLP / efficient-attention
  [EVA ICLR'23; LARA ICML'22] Efficient attention mechanisms via control variates, random features, and importance sampling
  ☆79Updated last year
• wxjiao / InstructMT
  A collection of instruction data and scripts for machine translation.
  ☆20Updated last year
• Jxu-Thu / DITTO
  The code of paper "Learning to Break the Loop: Analyzing and Mitigating Repetitions for Neural Text Generation" published at NeurIPS 202…
  ☆40Updated 2 years ago
• GeneZC / MiniMoE
  Code for ACL 2023 paper titled "Lifting the Curse of Capacity Gap in Distilling Language Models"
  ☆28Updated last year
• DAMO-NLP-SG / CLEX
  [ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models
  ☆72Updated 8 months ago
• RUCAIBox / QuantizedEmpirical
  ☆13Updated last year
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆44Updated last year
• yegcjs / mixinglaws
  ☆88Updated last month
• Shwai-He / MEO
  The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":
  ☆34Updated 7 months ago
• sunyt32 / torchscale
  Transformers at any scale
  ☆41Updated 9 months ago
• liutianlin0121 / decoding-time-realignment
  Implementation of "Decoding-time Realignment of Language Models", ICML 2024.
  ☆15Updated 4 months ago
• ZongqianLi / 500xCompressor
  ☆18Updated 2 months ago
• Academic-Hammer / HammerLLM
  1.4B sLLM for Chinese and English - HammerLLM🔨
  ☆43Updated 7 months ago
• FlagOpen / Infinity-Instruct
  ☆37Updated 4 months ago
• NormXU / Consistent-DynamicNTKRoPE
  An Experiment on Dynamic NTK Scaling RoPE
  ☆61Updated 11 months ago
• shaochenze / PatchTrain
  Code for paper "Patch-Level Training for Large Language Models"
  ☆67Updated 3 months ago
• Spico197 / watchmen
  😎 A simple and easy-to-use toolkit for GPU scheduling.
  ☆42Updated 3 years ago
• beyondguo / TrainingDynamics
  Compute training dynamics, plot data cartography, analysing data quality...
  ☆39Updated 2 years ago
• ernie-research / Tool-Augmented-Reward-Model
  [ICLR'24 spotlight] Tool-Augmented Reward Modeling
  ☆36Updated 8 months ago
• thu-ml / low-bit-optimizers
  Low-bit optimizers for PyTorch
  ☆118Updated last year
• JunnYu / FLASHQuad_pytorch
  FLASHQuad_pytorch
  ☆66Updated 2 years ago
• fastnlp / ElasticBERT
  A pre-trained model with multi-exit transformer architecture.
  ☆53Updated last year