Alternatives and similar repositories for LL3M

Users that are interested in LL3M are comparing it to the libraries listed below

• huggingface / m4-logs
  M4 experiment logbook
  ☆58Updated 2 years ago
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆100Updated last year
• reka-ai / reka-vibe-eval
  Multimodal language model benchmark, featuring challenging examples
  ☆176Updated 9 months ago
• declare-lab / LLM-PuzzleTest
  This repository is maintained to release dataset and models for multimodal puzzle reasoning.
  ☆104Updated 7 months ago
• lucidrains / coconut-pytorch
  Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch
  ☆180Updated 3 months ago
• RobertCsordas / moeut
  ☆85Updated last year
• ScalingIntelligence / large_language_monkeys
  ☆105Updated last year
• RobertCsordas / moe_attention
  Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"
  ☆99Updated last year
• shenao-zhang / SELM
  The official implementation of Self-Exploring Language Models (SELM)
  ☆64Updated last year
• wmn-231314 / diffusion-data-constraint
  Official PyTorch implementation and models for paper "Diffusion Beats Autoregressive in Data-Constrained Settings". We find diffusion mod…
  ☆98Updated last month
• huggingface / OBELICS
  Code used for the creation of OBELICS, an open, massive and curated collection of interleaved image-text web documents, containing 141M d…
  ☆206Updated last year
• allenai / easy-to-hard-generalization
  Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"
  ☆48Updated last year
• cloneofsimo / min-max-gpt
  Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training
  ☆132Updated last year
• locuslab / scaling_laws_data_filtering
  ☆65Updated last year
• lucidrains / PEER-pytorch
  Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind
  ☆128Updated last year
• facebookresearch / Mixture-of-Transformers
  Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Models. TMLR 2025.
  ☆107Updated 3 weeks ago
• architsharma97 / dpo-rlaif
  ☆100Updated last year
• itsnamgyu / block-transformer
  Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)
  ☆161Updated 5 months ago
• gregorbachmann / Next-Token-Failures
  ☆101Updated last year
• lucidrains / mirasol-pytorch
  Implementation of 🌻 Mirasol, SOTA Multimodal Autoregressive model out of Google Deepmind, in Pytorch
  ☆90Updated last year
• SynthLabsAI / big-math
  A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models
  ☆65Updated 7 months ago
• dangxingyu / rnn-icrag
  Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"
  ☆27Updated last year
• IBM / SALMON
  Self-Alignment with Principle-Following Reward Models
  ☆166Updated 2 weeks ago
• lucidrains / CALM-pytorch
  Implementation of CALM from the paper "LLM Augmented LLMs: Expanding Capabilities through Composition", out of Google Deepmind
  ☆178Updated last year
• sail-sg / scaling-with-vocab
  [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623
  ☆86Updated last year
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆78Updated last year
• LAION-AI / General-GPT
  ☆65Updated 2 years ago
• hamishivi / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆75Updated last year
• haoliuhl / language-quantized-autoencoders
  Language Quantized AutoEncoders
  ☆109Updated 2 years ago
• katiekang1998 / reasoning_generalization
  ☆33Updated 8 months ago