jiasenlu / LL3M

Related projects: ⓘ

• huggingface / m4-logs
  M4 experiment logbook
  ☆56Updated last year
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆91Updated 5 months ago
• reka-ai / reka-vibe-eval
  Multimodal language model benchmark, featuring challenging examples
  ☆144Updated last month
• RobertCsordas / moe_attention
  Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"
  ☆87Updated 8 months ago
• allenai / easy-to-hard-generalization
  Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"
  ☆44Updated 8 months ago
• cloneofsimo / min-fsdp
  ☆68Updated 2 months ago
• hkust-nlp / llm-compression-intelligence
  Official github repo for the paper "Compression Represents Intelligence Linearly"
  ☆121Updated 3 months ago
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆71Updated 3 months ago
• locuslab / scaling_laws_data_filtering
  ☆60Updated 5 months ago
• mgmalek / efficient_cross_entropy
  ☆66Updated 3 months ago
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆46Updated 9 months ago
• hamishivi / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆52Updated last month
• gregorbachmann / Next-Token-Failures
  ☆61Updated 6 months ago
• architsharma97 / dpo-rlaif
  ☆87Updated 2 months ago
• IBM / SALMON
  Self-Alignment with Principle-Following Reward Models
  ☆144Updated 6 months ago
• RobertCsordas / moeut
  ☆50Updated last month
• lucidrains / mixture-of-attention
  Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts
  ☆101Updated last year
• lucidrains / ReST-EM-pytorch
  ☆42Updated this week
• ronghanghu / vit_10b_fsdp_example
  See details in https://github.com/pytorch/xla/blob/r1.12/torch_xla/distributed/fsdp/README.md
  ☆21Updated last year
• facebookresearch / RAM
  A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).
  ☆15Updated last week
• huggingface / OBELICS
  Code used for the creation of OBELICS, an open, massive and curated collection of interleaved image-text web documents, containing 141M d…
  ☆183Updated 3 weeks ago
• kyleliang919 / Online-Subspace-Descent
  This repo is based on https://github.com/jiaweizzhao/GaLore, paper coming soon
  ☆18Updated this week
• dangxingyu / rnn-icrag
  Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"
  ☆24Updated 5 months ago
• LAION-AI / Big-Interleaved-Dataset
  Big-Interleaved-Dataset
  ☆57Updated last year
• yegcjs / DiffusionLLM
  Code for paper "Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning"
  ☆59Updated 7 months ago
• facebookresearch / RLCD
  Reproduction of "RLCD Reinforcement Learning from Contrast Distillation for Language Model Alignment
  ☆63Updated last year
• hadasah / btm
  ☆69Updated 4 months ago
• google-deepmind / randomized_positional_encodings
  Randomized Positional Encodings Boost Length Generalization of Transformers
  ☆78Updated 6 months ago
• lucidrains / infini-transformer-pytorch
  Implementation of Infini-Transformer in Pytorch
  ☆100Updated last month
• vwxyzjn / summarize_from_feedback_details
  ☆98Updated 2 months ago