Alternatives and similar repositories for lottery-ticket-adaptation

Users that are interested in lottery-ticket-adaptation are comparing it to the libraries listed below

• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆77Updated last year
• ctlllll / understanding_llm_benchmarks
  Understanding the correlation between different LLM benchmarks
  ☆29Updated last year
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆62Updated last year
• limenlp / safer-instruct
  This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"
  ☆17Updated last year
• shangshang-wang / Resa
  Resa: Transparent Reasoning Models via SAEs
  ☆46Updated 3 months ago
• ASTRAL-Group / LoRe
  When Reasoning Meets Its Laws
  ☆26Updated last week
• RobertCsordas / moeut
  ☆91Updated last year
• wang-kee / LiNeS
  Official repository of "LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging"
  ☆31Updated last year
• katiekang1998 / reasoning_generalization
  ☆33Updated 11 months ago
• sail-sg / SkyLadder
  The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling
  ☆41Updated this week
• aszala / EnvGen
  Official Code Repository for EnvGen: Generating and Adapting Environments via LLMs for Training Embodied Agents (COLM 2024)
  ☆39Updated last year
• r-three / RAD
  Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model
  ☆45Updated 2 months ago
• lilakk / BLEUBERI
  Official repository for "BLEUBERI: BLEU is a surprisingly effective reward for instruction following"
  ☆31Updated 6 months ago
• csinva / tree-prompt
  Tree prompting: easy-to-use scikit-learn interface for improved prompting.
  ☆40Updated 2 years ago
• yidingjiang / ado
  The repository contains code for Adaptive Data Optimization
  ☆30Updated last year
• RobertCsordas / moe_attention
  Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"
  ☆102Updated last year
• likenneth / q_probe
  Q-Probe: A Lightweight Approach to Reward Maximization for Language Models
  ☆41Updated last year
• Infini-AI-Lab / S2FT
  ☆19Updated 11 months ago
• zaydzuhri / flame
  Fork of Flame repo for training of some new stuff in development
  ☆19Updated this week
• arcee-ai / DAM
  ☆55Updated last year
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆35Updated last year
• nuochenpku / LLaMA_Analysis
  This is official project in our paper: Is Bigger and Deeper Always Better? Probing LLaMA Across Scales and Layers
  ☆31Updated last year
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆38Updated 6 months ago
• ahans30 / goldfish-loss
  [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs
  ☆93Updated last year
• dinobby / MAGDi
  The code implementation of MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Models…
  ☆38Updated last year
• para-lost / ReBase
  ReBase: Training Task Experts through Retrieval Based Distillation
  ☆29Updated 10 months ago
• cmu-l3 / neurips2024-inference-tutorial-code
  NeurIPS 2024 tutorial on LLM Inference
  ☆47Updated last year
• hamishivi / automated-instruction-selection
  Exploration of automated dataset selection approaches at large scales.
  ☆52Updated 9 months ago
• cvenhoff / steering-thinking-llms
  ☆32Updated 5 months ago
• shenao-zhang / SELM
  The official implementation of Self-Exploring Language Models (SELM)
  ☆63Updated last year