Alternatives and similar repositories for LL3M

Users that are interested in LL3M are comparing it to the libraries listed below

• huggingface / m4-logs
  M4 experiment logbook
  ☆58Updated 2 years ago
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆100Updated last year
• reka-ai / reka-vibe-eval
  Multimodal language model benchmark, featuring challenging examples
  ☆181Updated last year
• yegcjs / DiffusionLLM
  Code for paper "Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning"
  ☆83Updated last year
• lucidrains / coconut-pytorch
  Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch
  ☆181Updated 6 months ago
• locuslab / scaling_laws_data_filtering
  ☆64Updated last year
• RobertCsordas / moeut
  ☆91Updated last year
• declare-lab / LLM-PuzzleTest
  This repository is maintained to release dataset and models for multimodal puzzle reasoning.
  ☆113Updated 10 months ago
• wmn-231314 / diffusion-data-constraint
  Official PyTorch implementation and models for paper "Diffusion Beats Autoregressive in Data-Constrained Settings". We find diffusion mod…
  ☆117Updated last month
• gregorbachmann / Next-Token-Failures
  ☆107Updated last year
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆77Updated last year
• YuchuanTian / DiJiang
  [ICML'24 Oral] The official code of "DiJiang: Efficient Large Language Models through Compact Kernelization", a novel DCT-based linear at…
  ☆104Updated last year
• RobertCsordas / moe_attention
  Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"
  ☆102Updated last year
• cloneofsimo / min-max-gpt
  Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training
  ☆132Updated last year
• LAION-AI / General-GPT
  ☆65Updated 2 years ago
• huggingface / OBELICS
  Code used for the creation of OBELICS, an open, massive and curated collection of interleaved image-text web documents, containing 141M d…
  ☆210Updated last year
• ScalingIntelligence / large_language_monkeys
  ☆111Updated last year
• allenai / easy-to-hard-generalization
  Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"
  ☆48Updated last year
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆86Updated last year
• sail-sg / scaling-with-vocab
  [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623
  ☆89Updated last year
• IBM / SALMON
  Self-Alignment with Principle-Following Reward Models
  ☆169Updated 3 months ago
• shaochenze / PatchTrain
  Code for paper "Patch-Level Training for Large Language Models"
  ☆96Updated last month
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆47Updated last year
• wade3han / champagne
  An official codebase for paper " CHAMPAGNE: Learning Real-world Conversation from Large-Scale Web Videos (ICCV 23)"
  ☆52Updated 2 years ago
• mu-cai / matryoshka-mm
  Matryoshka Multimodal Models
  ☆121Updated 11 months ago
• microsoft / SparseMixer
  Sparse Backpropagation for Mixture-of-Expert Training
  ☆29Updated last year
• architsharma97 / dpo-rlaif
  ☆100Updated last year
• mlfoundations / VisIT-Bench
  ☆50Updated 2 years ago
• data-for-agents / insta
  Official Repo for InSTA: Towards Internet-Scale Training For Agents
  ☆55Updated 5 months ago
• ltzheng / Synapse
  [ICLR 2024] Trajectory-as-Exemplar Prompting with Memory for Computer Control
  ☆63Updated 11 months ago