Alternatives and similar repositories for Switch-Transformers-in-Seq2Seq:

Users that are interested in Switch-Transformers-in-Seq2Seq are comparing it to the libraries listed below

• Jxu-Thu / DITTO
  The code of paper "Learning to Break the Loop: Analyzing and Mitigating Repetitions for Neural Text Generation" published at NeurIPS 202…
  ☆46Updated 2 years ago
• john-hewitt / backpacks-flash-attn
  The original Backpack Language Model implementation, a fork of FlashAttention
  ☆67Updated last year
• thunlp / Knowledge-Inheritance
  Source code for paper: Knowledge Inheritance for Pre-trained Language Models
  ☆38Updated 2 years ago
• cliang1453 / SAGE
  No Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models (ICLR 2022)
  ☆30Updated 3 years ago
• yq-wen / overlapping-datasets
  ☆9Updated 3 years ago
• uds-lsv / MCSE
  NAACL 2022: MCSE: Multimodal Contrastive Learning of Sentence Embeddings
  ☆55Updated 10 months ago
• seonghyeonye / TAPP
  [AAAI 2024] Investigating the Effectiveness of Task-Agnostic Prefix Prompt for Instruction Following
  ☆79Updated 6 months ago
• liuzeming01 / XDailyDialog
  https://liuzeming01.github.io/XDailyDialog/
  ☆11Updated last year
• deep-spin / hallucinations-in-nmt
  ☆19Updated last year
• allenai / sso
  Repository for Skill Set Optimization
  ☆12Updated 8 months ago
• HLR / TSLM
  The Implementation for the Paper "Time-Stamped Language Model: Teaching Language Models toUnderstand The Flow of Events"
  ☆11Updated 3 years ago
• ZongqianLi / 500xCompressor
  Repository for the paper: 500xCompressor: Generalized Prompt Compression for Large Language Models
  ☆33Updated 7 months ago
• Spico197 / MoE-SFT
  🍼 Official implementation of Dynamic Data Mixing Maximizes Instruction Tuning for Mixture-of-Experts
  ☆38Updated 6 months ago
• NanshineLoong / Self-Evolving-Benchmark
  A framework for evolving and testing question-answering datasets with various models.
  ☆14Updated last year
• RUCAIBox / BAMBOO
  ☆34Updated last year
• choosewhatulike / case2code
  ☆15Updated this week
• joeljang / ELM
  [ICML 2023] Exploring the Benefits of Training Expert Language Models over Instruction Tuning
  ☆98Updated last year
• terarachang / DataICL
  Data Valuation on In-Context Examples (ACL23)
  ☆23Updated 2 months ago
• chijames / KERPLE
  ☆19Updated 2 years ago
• microsoft / AMOS
  [ICLR 2022] Pretraining Text Encoders with Adversarial Mixture of Training Signal Generators
  ☆24Updated last year
• facebookresearch / ELECTRA-Fewshot-Learning
  This repository contains the code for paper Prompting ELECTRA Few-Shot Learning with Discriminative Pre-Trained Models.
  ☆47Updated 2 years ago
• kyegomez / Reka-Torch
  Implementation of the model: "Reka Core, Flash, and Edge: A Series of Powerful Multimodal Language Models" in PyTorch
  ☆30Updated this week
• fuzihaofzh / repetition-problem-nlg
  Code for the paper "A Theoretical Analysis of the Repetition Problem in Text Generation" in AAAI 2021.
  ☆53Updated 2 years ago
• salesforce / FactLM
  ☆10Updated 3 years ago
• asahi417 / lm-vocab-trimmer
  Vocabulary Trimming (VT) is a model compression technique, which reduces a multilingual LM vocabulary to a target language by deleting ir…
  ☆35Updated 5 months ago
• caskcsg / ir
  ConTextual Mask Auto-Encoder for Dense Passage Retrieval
  ☆35Updated 5 months ago
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆48Updated 2 years ago
• PrasannS / rlhf-length-biases
  ☆27Updated last year
• frankxu2004 / knnlm-why
  Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"
  ☆56Updated 2 years ago
• allenai / data-efficient-finetuning
  Code for paper 'Data-Efficient FineTuning'
  ☆29Updated last year