Alternatives and similar repositories for balanced-kmeans

Users that are interested in balanced-kmeans are comparing it to the libraries listed below

• VITA-Group / Junk_DNA_Hypothesis
  [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…
  ☆16Updated 2 months ago
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆44Updated 9 months ago
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆80Updated last year
• Leooyii / LCEG
  Long Context Extension and Generalization in LLMs
  ☆57Updated 9 months ago
• hadasah / btm
  ☆74Updated last year
• RulinShao / RAG-evaluation-harnesses
  An evaluation suite for Retrieval-Augmented Generation (RAG).
  ☆20Updated last month
• microsoft / Stochastic-Mixture-of-Experts
  This package implements THOR: Transformer with Stochastic Experts.
  ☆65Updated 3 years ago
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆52Updated 2 years ago
• sjelassi / transformers_ssm_copy
  ☆32Updated last year
• raymin0223 / fast_robust_early_exit
  Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decoding (EMNLP 2023 Long)
  ☆60Updated 8 months ago
• tanyuqian / redco
  NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference
  ☆66Updated 6 months ago
• princeton-nlp / LM-Kernel-FT
  A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643
  ☆75Updated last year
• metacarbon / shareAtt
  Beyond KV Caching: Shared Attention for Efficient LLMs
  ☆19Updated 11 months ago
• nathanhu0 / CaMeLS
  Codebase for Context-aware Meta-learned Loss Scaling (CaMeLS). https://arxiv.org/abs/2305.15076.
  ☆25Updated last year
• kyleliang919 / Online-Subspace-Descent
  This repo is based on https://github.com/jiaweizzhao/GaLore
  ☆28Updated 9 months ago
• dangxingyu / rnn-icrag
  Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"
  ☆27Updated last year
• song-wx / SIFT
  [ICML2024 Spotlight] Fine-Tuning Pre-trained Large Language Models Sparsely
  ☆23Updated 11 months ago
• microsoft / AutoMoE
  AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers
  ☆47Updated 2 years ago
• ScalingIntelligence / large_language_monkeys
  ☆96Updated 8 months ago
• Infini-AI-Lab / gsm_infinite
  ☆47Updated last week
• felixzli / synthetic_pretraining
  ☆39Updated 2 years ago
• thunlp / MoEfication
  ☆137Updated 11 months ago
• VITA-Group / LoCoCo
  [ICML‘2024] "LoCoCo: Dropping In Convolutions for Long Context Compression", Ruisi Cai, Yuandong Tian, Zhangyang Wang, Beidi Chen
  ☆16Updated 9 months ago
• XiangLi1999 / AutoBencher
  ☆29Updated 11 months ago
• socialfoundations / tttlm
  Test-time-training on nearest neighbors for large language models
  ☆41Updated last year
• snu-mllab / Context-Memory
  Pytorch implementation for "Compressed Context Memory For Online Language Model Interaction" (ICLR'24)
  ☆61Updated last year
• yxli2123 / LoSparse
  ☆57Updated last year
• thunlp / Modularity-Analysis
  Repo for ACL2023 Findings paper "Emergent Modularity in Pre-trained Transformers"
  ☆25Updated 2 years ago
• tau-nlp / zero_scrolls
  Running inference on the ZeroSCROLLS benchmark
  ☆20Updated last year
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆76Updated last year