prateeky2806 / ties-merging

Related projects ⓘ

Alternatives and complementary repositories for ties-merging

• locuslab / massive-activations
  Code accompanying the paper "Massive Activations in Large Language Models"
  ☆123Updated 8 months ago
• bloomberg / dataless-model-merging
  Code release for Dataless Knowledge Fusion by Merging Weights of Language Models (https://openreview.net/forum?id=FCnohuR6AnM)
  ☆85Updated last year
• shengliu66 / ICV
  Code for In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steering
  ☆144Updated last month
• EnnengYang / AdaMerging
  AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.
  ☆52Updated 3 weeks ago
• roeehendel / icl_task_vectors
  ☆81Updated last year
• gortizji / tangent_task_arithmetic
  Source code of "Task arithmetic in the tangent space: Improved editing of pre-trained models".
  ☆87Updated last year
• logix-project / logix
  AI Logging for Interpretability and Explainability🔬
  ☆89Updated 5 months ago
• alisawuffles / proxy-tuning
  Code associated with Tuning Language Models by Proxy (Liu et al., 2024)
  ☆97Updated 7 months ago
• ericwtodd / function_vectors
  Function Vectors in Large Language Models (ICLR 2024)
  ☆119Updated last month
• microsoft / mttl
  Building modular LMs with parameter-efficient fine-tuning.
  ☆86Updated this week
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆198Updated 3 weeks ago
• UNITES-Lab / MC-SMoE
  [ICLR 2024 Spotlight] Code for the paper "Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy"
  ☆64Updated 5 months ago
• r-three / phatgoose
  Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"
  ☆78Updated 8 months ago
• QingruZhang / PASTA
  PASTA: Post-hoc Attention Steering for LLMs
  ☆108Updated 2 months ago
• CASE-Lab-UMD / LLM-Drop
  The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".
  ☆143Updated last week
• harveyhuang18 / EMR_Merging
  [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging
  ☆32Updated last month
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆94Updated 7 months ago
• IBM / SALMON
  Self-Alignment with Principle-Following Reward Models
  ☆147Updated 8 months ago
• TIGER-AI-Lab / LongICLBench
  Code and Data for "Long-context LLMs Struggle with Long In-context Learning"
  ☆91Updated 4 months ago
• mmatena / model_merging
  ☆63Updated 2 years ago
• jongwooko / distillm
  Official PyTorch implementation of DistiLLM: Towards Streamlined Distillation for Large Language Models (ICML 2024)
  ☆139Updated 2 months ago
• alon-albalak / data-selection-survey
  A Survey on Data Selection for Language Models
  ☆183Updated last month
• lyy1994 / awesome-data-contamination
  The Paper List on Data Contamination for Large Language Models Evaluation.
  ☆76Updated this week
• HanGuo97 / lq-lora
  ☆122Updated 10 months ago
• microsoft / rho
  Repo for Rho-1: Token-level Data Selection & Selective Pretraining of LLMs.
  ☆307Updated 7 months ago
• tianyang-x / SaySelf
  Public code repo for paper "SaySelf: Teaching LLMs to Express Confidence with Self-Reflective Rationales"
  ☆96Updated last month
• stanfordmlgroup / ManyICL
  ☆128Updated 6 months ago
• EnnengYang / Awesome-Model-Merging-Methods-Theories-Applications
  Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities. arXiv:2408.07666.
  ☆220Updated this week
• wuhy68 / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆129Updated 2 months ago
• snu-mllab / Context-Memory
  Pytorch implementation for "Compressed Context Memory For Online Language Model Interaction" (ICLR'24)
  ☆50Updated 7 months ago