Alternatives and similar repositories for encoder-decoder-slm

Users that are interested in encoder-decoder-slm are comparing it to the libraries listed below

• kyleliang919 / Online-Subspace-Descent
  This repo is based on https://github.com/jiaweizzhao/GaLore
  ☆27Updated 7 months ago
• Zyphra / Zyda_processing
  ☆33Updated 10 months ago
• ltgoslo / bert-in-context
  Official implementation of "BERTs are Generative In-Context Learners"
  ☆27Updated 2 months ago
• google-deepmind / xtr
  XTR: Rethinking the Role of Token Retrieval in Multi-Vector Retrieval
  ☆51Updated 10 months ago
• Knowledgator / FlashDeBERTa
  Trully flash implementation of DeBERTa disentangled attention mechanism.
  ☆48Updated last week
• evanatyourservice / llm-jax
  Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.
  ☆17Updated last month
• NathanGodey / qfilters
  Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)
  ☆30Updated 2 months ago
• arcee-ai / DAM
  ☆48Updated 6 months ago
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆47Updated 8 months ago
• VITA-Group / WeLore
  From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients. Ajay Jaiswal, Lu Yin, Zhenyu Zhang, Shiwei Liu,…
  ☆47Updated 3 weeks ago
• EleutherAI / improved-t5
  Experiments for efforts to train a new and improved t5
  ☆77Updated last year
• kjslag / spacebyte
  A byte-level decoder architecture that matches the performance of tokenized Transformers.
  ☆63Updated last year
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆57Updated 8 months ago
• RobertCsordas / moeut
  ☆78Updated 8 months ago
• prateeky2806 / ComPEFT
  ☆25Updated last year
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆43Updated 3 months ago
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆57Updated last year
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆36Updated last year
• argilla-io / distilabel-spin-dibt
  Repository containing the SPIN experiments on the DIBT 10k ranked prompts
  ☆24Updated last year
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆45Updated 9 months ago
• allenai / infinigram-api
  ☆56Updated last week
• apple / ml-hypercloning
  ☆47Updated 6 months ago
• wdlctc / mini-s
  ☆51Updated 6 months ago
• jkallini / mrt5
  Code repository for the paper "MrT5: Dynamic Token Merging for Efficient Byte-level Language Models."
  ☆40Updated last month
• epfml / DenseFormer
  ☆81Updated last year
• catie-aq / flashT5
  A fast implementation of T5/UL2 in PyTorch using Flash Attention
  ☆103Updated last month
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• nanowell / Q-Sparse-LLM
  My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated
  ☆32Updated 9 months ago
• pchizhov / picky_bpe
  BPE modification that implements removing of the intermediate tokens during tokenizer training.
  ☆25Updated 5 months ago
• melisa-writer / short-transformers
  Prune transformer layers
  ☆69Updated 11 months ago