Alternatives and similar repositories for lottery-ticket-adaptation

Users that are interested in lottery-ticket-adaptation are comparing it to the libraries listed below

• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆78Updated last year
• ctlllll / understanding_llm_benchmarks
  Understanding the correlation between different LLM benchmarks
  ☆29Updated last year
• shangshang-wang / Resa
  Resa: Transparent Reasoning Models via SAEs
  ☆41Updated 2 weeks ago
• limenlp / safer-instruct
  This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"
  ☆17Updated last year
• The-Inscrutable-X / TACQ
  Official Repository for Task-Circuit Quantization
  ☆23Updated 3 months ago
• zaydzuhri / flame
  Fork of Flame repo for training of some new stuff in development
  ☆15Updated last month
• csinva / tree-prompt
  Tree prompting: easy-to-use scikit-learn interface for improved prompting.
  ☆40Updated last year
• aszala / EnvGen
  Official Code Repository for EnvGen: Generating and Adapting Environments via LLMs for Training Embodied Agents (COLM 2024)
  ☆35Updated last year
• katiekang1998 / reasoning_generalization
  ☆34Updated 7 months ago
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆38Updated 2 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆60Updated last year
• lilakk / BLEUBERI
  Official repository for "BLEUBERI: BLEU is a surprisingly effective reward for instruction following"
  ☆25Updated 2 months ago
• para-lost / ReBase
  ReBase: Training Task Experts through Retrieval Based Distillation
  ☆29Updated 6 months ago
• sail-sg / SkyLadder
  The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling
  ☆33Updated last week
• yidingjiang / ado
  The repository contains code for Adaptive Data Optimization
  ☆25Updated 8 months ago
• dinobby / MAGDi
  The code implementation of MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Models…
  ☆36Updated last year
• r-three / RAD
  Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model
  ☆44Updated last year
• IST-DASLab / RoSA
  Official implementation of the ICML 2024 paper RoSA (Robust Adaptation)
  ☆44Updated last year
• wang-kee / LiNeS
  Official repository of "LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging"
  ☆30Updated 9 months ago
• Infini-AI-Lab / S2FT
  ☆19Updated 7 months ago
• arcee-ai / DAM
  ☆54Updated 9 months ago
• VITA-Group / WeLore
  From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients. Ajay Jaiswal, Lu Yin, Zhenyu Zhang, Shiwei Liu,…
  ☆47Updated 4 months ago
• schauppi / Self-Rewarding-Language-Models
  ☆46Updated last year
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆34Updated last year
• RobertCsordas / moe_attention
  Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"
  ☆98Updated 11 months ago
• RobertCsordas / moeut
  ☆85Updated last year
• hamishivi / automated-instruction-selection
  Exploration of automated dataset selection approaches at large scales.
  ☆47Updated 5 months ago
• EternityYW / Gemini-Commonsense-Evaluation
  Official implementation of "Gemini in Reasoning: Unveiling Commonsense in Multimodal Large Language Models"
  ☆36Updated last year
• jiwonsong-dev / ReasoningPathCompression
  Official implementation of "Reasoning Path Compression: Compressing Generation Trajectories for Efficient LLM Reasoning"
  ☆21Updated 3 months ago
• sunblaze-ucb / math_ood
  ☆39Updated 2 months ago