Alternatives and similar repositories for LL3M

Users that are interested in LL3M are comparing it to the libraries listed below

• huggingface / m4-logs
  M4 experiment logbook
  ☆58Updated 2 years ago
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆99Updated last year
• reka-ai / reka-vibe-eval
  Multimodal language model benchmark, featuring challenging examples
  ☆183Updated last year
• RobertCsordas / moeut
  ☆91Updated last year
• declare-lab / LLM-PuzzleTest
  This repository is maintained to release dataset and models for multimodal puzzle reasoning.
  ☆113Updated 11 months ago
• cloneofsimo / min-max-gpt
  Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training
  ☆132Updated last year
• lucidrains / coconut-pytorch
  Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch
  ☆182Updated 7 months ago
• RobertCsordas / moe_attention
  Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"
  ☆102Updated last year
• huggingface / OBELICS
  Code used for the creation of OBELICS, an open, massive and curated collection of interleaved image-text web documents, containing 141M d…
  ☆211Updated last year
• wmn-231314 / diffusion-data-constraint
  Official PyTorch implementation and models for paper "Diffusion Beats Autoregressive in Data-Constrained Settings". We find diffusion mod…
  ☆119Updated 3 weeks ago
• ScalingIntelligence / large_language_monkeys
  ☆112Updated last year
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆77Updated last year
• lucidrains / PEER-pytorch
  Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind
  ☆134Updated 3 months ago
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆88Updated last year
• shaochenze / PatchTrain
  Code for paper "Patch-Level Training for Large Language Models"
  ☆97Updated 2 months ago
• lucidrains / llama-qrlhf
  Implementation of the Llama architecture with RLHF + Q-learning
  ☆170Updated last year
• gregorbachmann / Next-Token-Failures
  ☆108Updated last year
• itsnamgyu / block-transformer
  Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)
  ☆163Updated 9 months ago
• locuslab / scaling_laws_data_filtering
  ☆64Updated last year
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆47Updated last year
• apple / ml-planner
  ☆56Updated last year
• shenao-zhang / SELM
  The official implementation of Self-Exploring Language Models (SELM)
  ☆63Updated last year
• allenai / easy-to-hard-generalization
  Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"
  ☆48Updated 2 years ago
• sail-sg / scaling-with-vocab
  [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623
  ☆89Updated last year
• IBM / SALMON
  Self-Alignment with Principle-Following Reward Models
  ☆169Updated 4 months ago
• lucidrains / infini-transformer-pytorch
  Implementation of Infini-Transformer in Pytorch
  ☆112Updated last year
• hamishivi / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆78Updated last year
• architsharma97 / dpo-rlaif
  ☆99Updated last year
• HazyResearch / prefix-linear-attention
  ☆57Updated last year
• huyphan168 / PEER
  Mixture of A Million Experts
  ☆53Updated last year