Alternatives and similar repositories for Mixture-of-Experts-Sentence-Similarity

Users that are interested in Mixture-of-Experts-Sentence-Similarity are comparing it to the libraries listed below

• Alab-NII / Awesome-SciLM
  Pre-trained Language Model for Scientific Text
  ☆45Updated last year
• Yuanhy1997 / SeqDiffuSeq
  Text Diffusion Model with Encoder-Decoder Transformers for Sequence-to-Sequence Generation [NAACL 2024]
  ☆99Updated 2 years ago
• TianduoWang / DiffAug
  [EMNLP 2022] Differentiable Data Augmentation for Contrastive Sentence Representation Learning. https://arxiv.org/abs/2210.16536
  ☆40Updated 3 years ago
• theblackcat102 / unify-learning-paradigms
  data collator for UL2 and U-PaLM
  ☆29Updated 2 years ago
• FranxYao / Retrieval-Head-with-Flash-Attention
  Efficient retrieval head analysis with triton flash attention that supports topK probability
  ☆13Updated last year
• alon-albalak / FLAD
  Few-shot Learning with Auxiliary Data
  ☆31Updated 2 years ago
• vvvm23 / sundae
  Unofficial PyTorch implementation of "Step-unrolled Denoising Autoencoders for Text Generation"
  ☆24Updated 3 years ago
• sanyalsunny111 / Early_Weight_Avg
  [COLM 2024] Early Weight Averaging meets High Learning Rates for LLM Pre-training
  ☆18Updated last year
• AntNLP / nope_head_scale
  ☆29Updated last year
• ltgoslo / bert-in-context
  Official implementation of "BERTs are Generative In-Context Learners"
  ☆32Updated 10 months ago
• sail-sg / scaling-with-vocab
  [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623
  ☆89Updated last year
• Namco0816 / PT-BERT
  ACL 2022(findings): A Sentence is Worth 128 Pseudo Tokens: A Semantic-Aware Contrastive Learning Framework for Sentence Embeddings
  ☆18Updated 3 years ago
• hkust-nlp / SynCSE
  This is the official implementation of the paper: "Contrastive Learning of Sentence Embeddings from Scratch"
  ☆40Updated 2 years ago
• catie-aq / flashT5
  A fast implementation of T5/UL2 in PyTorch using Flash Attention
  ☆113Updated 3 months ago
• dptech-corp / Uni-SMART
  ☆51Updated last year
• EleutherAI / pile_dedupe
  Pile Deduplication Code
  ☆19Updated 2 years ago
• john-hewitt / implicit-ins
  Codebase for Instruction Following without Instruction Tuning
  ☆36Updated last year
• googleinterns / localizing-paragraph-memorization
  ☆15Updated last year
• zwhe99 / LLM-MT-Eval
  {DeepL, Google, WMT-Best, davinci-003, turbo, gpt-4} × {En-De, En-Cs, En-Ru, En-Zh, De-Fr, En-Ja, Uk-En, Uk-Cs, En-Hr, En-Ha, En-Is}
  ☆14Updated 2 years ago
• yangjackie / Topics-on-diffusion-generative-models
  ☆28Updated 4 months ago
• ducdauge / sft-llm
  Scaling Sparse Fine-Tuning to Large Language Models
  ☆18Updated 2 years ago
• thoppe / The-Pile-PubMed
  Download, parse, and filter data PubMed, data-ready for The-Pile
  ☆23Updated 4 years ago
• kamanphoebe / Look-into-MoEs
  [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Models
  ☆58Updated 11 months ago
• CyndxAI / QKNorm
  Code for the paper "Query-Key Normalization for Transformers"
  ☆50Updated 4 years ago
• gmftbyGMFTBY / Rep-Dropout
  [NeurIPS 2023] Repetition In Repetition Out: Towards Understanding Neural Text Degeneration from the Data Perspective
  ☆39Updated 2 years ago
• allenai / EmbeddingRecycling
  Embedding Recycling for Language models
  ☆38Updated 2 years ago
• abhika-m / FAVA
  ☆75Updated last year
• ProtLLM / ProtLLM
  [ACL 2024] ProtLLM: An Interleaved Protein-Language LLM with Protein-as-Word Pre-Training
  ☆50Updated last year
• allenai / easy-to-hard-generalization
  Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"
  ☆48Updated 2 years ago
• salesforce / genhance
  ☆34Updated 9 months ago