wang-kee / LiNeS

Related projects ⓘ

Alternatives and complementary repositories for LiNeS

• RobertCsordas / moeut
  ☆61Updated 2 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆46Updated 2 months ago
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆74Updated 5 months ago
• frankxwang / dpo-prefix-sharing
  DPO, but faster 🚀
  ☆20Updated 2 weeks ago
• yidingjiang / ado
  The repository contains code for Adaptive Data Optimization
  ☆18Updated 3 weeks ago
• TianduoWang / DPO-ST
  [ACL 2024] Self-Training with Direct Preference Optimization Improves Chain-of-Thought Reasoning
  ☆30Updated 3 months ago
• Zyphra / Zyda_processing
  ☆26Updated 4 months ago
• formll / resolving-scaling-law-discrepancies
  ☆15Updated 4 months ago
• john-hewitt / implicit-ins
  Codebase for Instruction Following without Instruction Tuning
  ☆29Updated last month
• VITA-Group / WeLore
  From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients. Ajay Jaiswal, Lu Yin, Zhenyu Zhang, Shiwei Liu,…
  ☆43Updated 3 months ago
• ahans30 / goldfish-loss
  [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs
  ☆74Updated 2 weeks ago
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆44Updated 2 months ago
• du-nlp-lab / MLR-Copilot
  ☆57Updated last month
• epfml / schedules-and-scaling
  ☆50Updated last week
• IST-DASLab / RoSA
  ☆34Updated 8 months ago
• uscnlp-lime / safer-instruct
  This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"
  ☆17Updated 8 months ago
• dangxingyu / rnn-icrag
  Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"
  ☆24Updated 6 months ago
• allenai / easy-to-hard-generalization
  Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"
  ☆44Updated 9 months ago
• r-three / phatgoose
  Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"
  ☆78Updated 8 months ago
• sail-sg / scaling-with-vocab
  [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623
  ☆67Updated last month
• nverma1 / merging-text-transformers
  Code for "Merging Text Transformers from Different Initializations"
  ☆19Updated 3 months ago
• yale-nlp / refdpo
  ☆15Updated 3 months ago
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆36Updated 11 months ago
• RobertCsordas / moe_attention
  Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"
  ☆91Updated last month
• Qichuzyy / POA
  Official implementation of ECCV24 paper: POA
  ☆24Updated 3 months ago
• uclaml / MoE
  Towards Understanding the Mixture-of-Experts Layer in Deep Learning
  ☆21Updated 11 months ago
• activatedgeek / calibration-tuning
  ☆34Updated 3 months ago
• kyleliang919 / Online-Subspace-Descent
  This repo is based on https://github.com/jiaweizzhao/GaLore
  ☆18Updated last month
• SalesforceAIResearch / GemFilter
  ☆62Updated last month
• ml-jku / EVA
  One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation
  ☆29Updated 3 weeks ago