facebookresearch / RAM

Related projects: ⓘ

• sail-sg / scaling-with-vocab
  📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623
  ☆52Updated 3 weeks ago
• dangxingyu / rnn-icrag
  Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"
  ☆24Updated 5 months ago
• allenai / easy-to-hard-generalization
  Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"
  ☆44Updated 8 months ago
• hkust-nlp / dart-math
  Official implementation for the paper *🎯DART-Math: Difficulty-Aware Rejection Tuning for Mathematical Problem-Solving*
  ☆57Updated 3 weeks ago
• Shwai-He / LLM-Drop
  The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".
  ☆43Updated last week
• casmlab / NPHardEval
  Repository for NPHardEval, a quantified-dynamic benchmark of LLMs
  ☆46Updated 5 months ago
• RulinShao / retrieval-scaling
  Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".
  ☆81Updated 2 weeks ago
• sail-sg / dice
  Official implementation of Bootstrapping Language Models via DPO Implicit Rewards
  ☆33Updated last month
• sjelassi / transformers_ssm_copy
  ☆22Updated 6 months ago
• GAIR-NLP / benbench
  Benchmarking Benchmark Leakage in Large Language Models
  ☆39Updated 4 months ago
• chujiezheng / LLM-Extrapolation
  Official repository for paper "Weak-to-Strong Extrapolation Expedites Alignment"
  ☆62Updated 3 months ago
• srush / LLM-Talk
  ☆45Updated 7 months ago
• HazyResearch / prefix-linear-attention
  ☆41Updated 2 months ago
• TianduoWang / DPO-ST
  [ACL 2024] Self-Training with Direct Preference Optimization Improves Chain-of-Thought Reasoning
  ☆24Updated last month
• r-three / RAD
  Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model
  ☆40Updated 8 months ago
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆53Updated 5 months ago
• yale-nlp / refdpo
  ☆13Updated last month
• RLHFlow / Directional-Preference-Alignment
  Directional Preference Alignment
  ☆44Updated 3 months ago
• gregorbachmann / Next-Token-Failures
  ☆61Updated 6 months ago
• wellecks / lm-evaluation-harness
  A framework for few-shot evaluation of autoregressive language models.
  ☆23Updated 8 months ago
• activatedgeek / calibration-tuning
  ☆30Updated last month
• sustcsonglin / mamba-triton
  ☆42Updated 7 months ago
• yegcjs / DiffusionLLM
  Code for paper "Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning"
  ☆59Updated 7 months ago
• lfsszd / CS-Drafting
  Cascade Speculative Drafting
  ☆23Updated 5 months ago
• yikangshen / megablocks
  ☆18Updated 3 months ago
• snu-mllab / Context-Memory
  Pytorch implementation for "Compressed Context Memory For Online Language Model Interaction" (ICLR'24)
  ☆47Updated 5 months ago
• shenao-zhang / SELM
  The official implementation of Self-Exploring Language Models (SELM)
  ☆55Updated 3 months ago
• hkust-nlp / llm-compression-intelligence
  Official github repo for the paper "Compression Represents Intelligence Linearly"
  ☆121Updated 3 months ago
• ernie-research / Tool-Augmented-Reward-Model
  [ICLR'24 spotlight] Tool-Augmented Reward Modeling
  ☆33Updated 6 months ago
• kamanphoebe / Look-into-MoEs
  A Closer Look into Mixture-of-Experts in Large Language Models
  ☆38Updated last month