Alternatives and similar repositories for Mixture-of-Experts-Sentence-Similarity

Users that are interested in Mixture-of-Experts-Sentence-Similarity are comparing it to the libraries listed below

• kyegomez / Reka-Torch
  Implementation of the model: "Reka Core, Flash, and Edge: A Series of Powerful Multimodal Language Models" in PyTorch
  ☆28Updated this week
• sanyalsunny111 / Early_Weight_Avg
  [COLM 2024] Early Weight Averaging meets High Learning Rates for LLM Pre-training
  ☆17Updated last year
• maszhongming / ParaKnowTransfer
  Code for "Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective"
  ☆32Updated last year
• Alab-NII / Awesome-SciLM
  Pre-trained Language Model for Scientific Text
  ☆46Updated last year
• kyegomez / LM-Infinite
  Implementation of "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"
  ☆39Updated 11 months ago
• kyegomez / EAOT
  The open source implementation of "Connecting Large Language Models with Evolutionary Algorithms Yields Powerful Prompt Optimizers"
  ☆18Updated last year
• kyegomez / Infini-attention
  Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…
  ☆56Updated this week
• alon-albalak / FLAD
  Few-shot Learning with Auxiliary Data
  ☆31Updated last year
• ltgoslo / bert-in-context
  Official implementation of "BERTs are Generative In-Context Learners"
  ☆32Updated 7 months ago
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆20Updated 8 months ago
• kamanphoebe / Look-into-MoEs
  [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Models
  ☆55Updated 8 months ago
• john-hewitt / implicit-ins
  Codebase for Instruction Following without Instruction Tuning
  ☆36Updated last year
• iiis-ai / IterativeQuestionComposing
  [AAAI 2025] Augmenting Math Word Problems via Iterative Question Composing (https://arxiv.org/abs/2401.09003)
  ☆20Updated 2 weeks ago
• princeton-pli / QRHead
  QRHead: Query-Focused Retrieval Heads Improve Long-Context Reasoning and Re-ranking
  ☆24Updated last month
• gersteinlab / BioCoder
  BioCoder: A Benchmark for Bioinformatics Code Generation with Large Language Models https://arxiv.org/abs/2308.16458
  ☆51Updated 2 months ago
• allenai / EmbeddingRecycling
  Embedding Recycling for Language models
  ☆38Updated 2 years ago
• HazyResearch / prefix-linear-attention
  ☆56Updated last year
• googleinterns / localizing-paragraph-memorization
  ☆15Updated last year
• luohongyin / UniLC
  Interpretable unified language safety checking with large language models
  ☆31Updated 2 years ago
• casmlab / NPHardEval
  Repository for NPHardEval, a quantified-dynamic benchmark of LLMs
  ☆59Updated last year
• ThomasScialom / T0_continual_learning
  Adding new tasks to T0 without catastrophic forgetting
  ☆33Updated 2 years ago
• vvvm23 / sundae
  Unofficial PyTorch implementation of "Step-unrolled Denoising Autoencoders for Text Generation"
  ☆24Updated 2 years ago
• EleutherAI / pile_dedupe
  Pile Deduplication Code
  ☆19Updated 2 years ago
• kaistAI / factual-knowledge-acquisition
  ☆22Updated 2 months ago
• sunyt32 / torchscale
  Transformers at any scale
  ☆41Updated last year
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆55Updated 2 years ago
• debjitpaul / Causal_CoT
  About The corresponding code from our paper " Making Reasoning Matter: Measuring and Improving Faithfulness of Chain-of-Thought Reasoning…
  ☆12Updated last year
• lsj2408 / URPE
  [NeurIPS 2022] Your Transformer May Not be as Powerful as You Expect (official implementation)
  ☆32Updated 2 years ago
• allenai / easy-to-hard-generalization
  Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"
  ☆48Updated last year
• RUCAIBox / BAMBOO
  ☆35Updated last year