sail-sg / scaling-with-vocab

Related projects: ⓘ

• Shwai-He / LLM-Drop
  The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".
  ☆43Updated last week
• yegcjs / DiffusionLLM
  Code for paper "Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning"
  ☆59Updated 7 months ago
• TianduoWang / DPO-ST
  [ACL 2024] Self-Training with Direct Preference Optimization Improves Chain-of-Thought Reasoning
  ☆24Updated last month
• sail-sg / dice
  Official implementation of Bootstrapping Language Models via DPO Implicit Rewards
  ☆33Updated last month
• HKUNLP / diffusion-of-thoughts
  Code for the paper "Diffusion of Thoughts: Chain-of-Thought Reasoning in Diffusion Language Models"
  ☆65Updated 6 months ago
• RLHFlow / Directional-Preference-Alignment
  Directional Preference Alignment
  ☆44Updated 3 months ago
• hkust-nlp / dart-math
  Official implementation for the paper *🎯DART-Math: Difficulty-Aware Rejection Tuning for Mathematical Problem-Solving*
  ☆57Updated 3 weeks ago
• chujiezheng / LLM-Extrapolation
  Official repository for paper "Weak-to-Strong Extrapolation Expedites Alignment"
  ☆62Updated 3 months ago
• casmlab / NPHardEval
  Repository for NPHardEval, a quantified-dynamic benchmark of LLMs
  ☆46Updated 5 months ago
• princeton-nlp / Edge-Pruning
  Code and data for the paper "Finding Transformer Circuits with Edge Pruning".
  ☆20Updated 2 months ago
• haozheji / exact-optimization
  ICML 2024 - Official Repository for EXO: Towards Efficient Exact Optimization of Language Model Alignment
  ☆45Updated 3 months ago
• facebookresearch / RAM
  A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).
  ☆15Updated this week
• yale-nlp / refdpo
  ☆13Updated last month
• jihoontack / MAC
  Online Adaptation of Language Models with a Memory of Amortized Contexts
  ☆51Updated last month
• princeton-nlp / PTP
  Improving Language Understanding from Screenshots. Paper: https://arxiv.org/abs/2402.14073
  ☆24Updated 2 months ago
• GAIR-NLP / weak-to-strong-reasoning
  ☆46Updated 2 weeks ago
• zhenyuhe00 / BiPE
  Two Stones Hit One Bird: Bilevel Positional Encoding for Better Length Extrapolation, ICML 2024
  ☆20Updated 2 months ago
• RUCAIBox / RLMEC
  The official repository of "Improving Large Language Models via Fine-grained Reinforcement Learning with Minimum Editing Constraint"
  ☆28Updated 8 months ago
• Shwai-He / MEO
  The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":
  ☆31Updated 5 months ago
• googleinterns / localizing-paragraph-memorization
  ☆14Updated 6 months ago
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆42Updated last year
• cxcscmu / MATES
  Official repository for MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models
  ☆42Updated last week
• allenai / easy-to-hard-generalization
  Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"
  ☆44Updated 8 months ago
• YuxiXie / SelfEval-Guided-Decoding
  ☆80Updated 9 months ago
• activatedgeek / calibration-tuning
  ☆30Updated last month
• hkust-nlp / Activation_Decoding
  ☆42Updated 5 months ago
• hbin0701 / Self-Explore
  Self-Explore to avoid ️the p️️it! Improving the Reasoning Capabilities of Language Models with Fine-grained Rewards
  ☆39Updated 4 months ago
• abhishekpanigrahi1996 / transformer_in_transformer
  ☆44Updated 11 months ago
• Wang-ML-Lab / multimodal-needle-in-a-haystack
  Code and data for the benchmark "Multimodal Needle in a Haystack (MMNeedle): Benchmarking Long-Context Capability of Multimodal Large Lan…
  ☆30Updated 2 months ago
• zjunlp / KnowledgeCircuits
  Knowledge Circuits in Pretrained Transformers
  ☆46Updated this week