Alternatives and similar repositories for encoder-decoder-slm:

Users that are interested in encoder-decoder-slm are comparing it to the libraries listed below

• leloykun / modded-nanogpt
  NanoGPT (124M) quality in 2.67B tokens
  ☆28Updated this week
• kyleliang919 / Online-Subspace-Descent
  This repo is based on https://github.com/jiaweizzhao/GaLore
  ☆26Updated 7 months ago
• evanatyourservice / llm-jax
  Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.
  ☆17Updated last month
• Knowledgator / FlashDeBERTa
  Trully flash implementation of DeBERTa disentangled attention mechanism.
  ☆45Updated last week
• RobertCsordas / moeut
  ☆77Updated 8 months ago
• arcee-ai / DAM
  ☆48Updated 5 months ago
• Zyphra / Zyda_processing
  ☆33Updated 10 months ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆41Updated 2 months ago
• NathanGodey / qfilters
  Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)
  ☆28Updated last month
• ltgoslo / bert-in-context
  Official implementation of "BERTs are Generative In-Context Learners"
  ☆26Updated last month
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆47Updated 7 months ago
• google-deepmind / asyncdiloco
  ☆43Updated last year
• epfml / DenseFormer
  ☆79Updated last year
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆45Updated 9 months ago
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆37Updated last year
• warner-benjamin / optimi
  Fast, Modern, Memory Efficient, and Low Precision PyTorch Optimizers
  ☆90Updated 9 months ago
• ml-jku / EVA
  One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation
  ☆39Updated 6 months ago
• google-deepmind / xtr
  XTR: Rethinking the Role of Token Retrieval in Multi-Vector Retrieval
  ☆50Updated 10 months ago
• prateeky2806 / ComPEFT
  ☆25Updated last year
• argilla-io / distilabel-spin-dibt
  Repository containing the SPIN experiments on the DIBT 10k ranked prompts
  ☆24Updated last year
• jadechip / nanoXLSTM
  The simplest, fastest repository for training/finetuning medium-sized xLSTMs.
  ☆42Updated 11 months ago
• kjslag / spacebyte
  A byte-level decoder architecture that matches the performance of tokenized Transformers.
  ☆63Updated last year
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆47Updated last year
• VatsaDev / NanoPoor
  NanoGPT-speedrunning for the poor T4 enjoyers
  ☆62Updated this week
• frankxwang / dpo-prefix-sharing
  DPO, but faster 🚀
  ☆40Updated 4 months ago
• euclaise / supertrainer2000
  ☆49Updated last year
• jkallini / mrt5
  Code repository for the paper "MrT5: Dynamic Token Merging for Efficient Byte-level Language Models."
  ☆38Updated last week
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆85Updated 2 months ago
• luyug / magix
  Supercharge huggingface transformers with model parallelism.
  ☆76Updated 6 months ago
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆19Updated 2 months ago