chandar-lab / EfficientLLMs

Related projects ⓘ

Alternatives and complementary repositories for EfficientLLMs

• kyegomez / Reka-Torch
  Implementation of the model: "Reka Core, Flash, and Edge: A Series of Powerful Multimodal Language Models" in PyTorch
  ☆29Updated last week
• tding1 / Efficient-LLM-Survey
  The Efficiency Spectrum of LLM
  ☆52Updated 11 months ago
• facebookresearch / coocmap
  code for paper "Accessing higher dimensions for unsupervised word translation"
  ☆21Updated last year
• ducdauge / sft-llm
  Scaling Sparse Fine-Tuning to Large Language Models
  ☆17Updated 9 months ago
• BlinkDL / LinearAttentionArena
  Here we will test various linear attention designs.
  ☆56Updated 6 months ago
• prateeky2806 / ComPEFT
  ☆25Updated 11 months ago
• srush / LLM-Talk
  ☆47Updated 9 months ago
• ZongqianLi / 500xCompressor
  ☆18Updated 3 months ago
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆44Updated last year
• IST-DASLab / RoSA
  ☆35Updated 9 months ago
• jdf-prog / LLM-Engines
  ☆30Updated this week
• yikangshen / megablocks
  ☆18Updated 5 months ago
• VITA-Group / WeLore
  From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients. Ajay Jaiswal, Lu Yin, Zhenyu Zhang, Shiwei Liu,…
  ☆43Updated 4 months ago
• chenllliang / MMEvalPro
  Source code for MMEvalPro, a more trustworthy and efficient benchmark for evaluating LMMs
  ☆22Updated last month
• kamanphoebe / Look-into-MoEs
  A Closer Look into Mixture-of-Experts in Large Language Models
  ☆40Updated 3 months ago
• mlfoundations / dataset2metadata
  ☆21Updated 8 months ago
• DRSY / KV_Compression
  [EMNLP 2023]Context Compression for Auto-regressive Transformers with Sentinel Tokens
  ☆21Updated last year
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆40Updated 2 months ago
• sanagno / adaptively_sparse_attention
  ☆17Updated last year
• M3-IT / YING-VLM
  Vision Large Language Models trained on M3IT instruction tuning dataset
  ☆17Updated last year
• sail-sg / scaling-with-vocab
  [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623
  ☆69Updated last month
• facebookresearch / lss_eval
  This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…
  ☆31Updated last year
• maszhongming / ParaKnowTransfer
  Code for "Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective"
  ☆30Updated 6 months ago
• raymin0223 / fast_robust_early_exit
  Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decoding (EMNLP 2023 Long)
  ☆53Updated last month
• allenai / OLMo-core
  PyTorch building blocks for OLMo
  ☆18Updated this week
• kyleliang919 / Online-Subspace-Descent
  This repo is based on https://github.com/jiaweizzhao/GaLore
  ☆19Updated 2 months ago
• dangxingyu / rnn-icrag
  Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"
  ☆24Updated 7 months ago
• Leooyii / LCEG
  Long Context Extension and Generalization in LLMs
  ☆39Updated 2 months ago
• BaiTheBest / SparseLLM
  Official Repo for SparseLLM: Global Pruning of LLMs (NeurIPS 2024)
  ☆38Updated this week
• allenai / sso
  Repository for Skill Set Optimization
  ☆12Updated 3 months ago