Alternatives and similar repositories for spring2024-lectures:

Users that are interested in spring2024-lectures are comparing it to the libraries listed below

• neubig / minllama-assignment
  ☆81Updated 5 months ago
• llm-efficiency-challenge / neurips_llm_efficiency_challenge
  NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
  ☆255Updated last year
• CASE-Lab-UMD / LLM-Drop
  The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".
  ☆162Updated 3 months ago
• huggingface / picotron_tutorial
  ☆145Updated 2 weeks ago
• HazyResearch / aisys-building-blocks
  Building blocks for foundation models.
  ☆456Updated last year
• yihedeng9 / rlhf-summary-notes
  A brief and partial summary of RLHF algorithms.
  ☆115Updated this week
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆231Updated 3 months ago
• facebookresearch / LayerSkip
  Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024
  ☆275Updated last week
• gpu-mode / profiling-cuda-in-torch
  ☆146Updated last year
• foundation-model-stack / fms-fsdp
  🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…
  ☆226Updated last week
• nightdessert / Retrieval_Head
  open-source code for paper: Retrieval Head Mechanistically Explains Long-Context Factuality
  ☆175Updated 7 months ago
• srush / awesome-o1
  A bibliography and survey of the papers surrounding o1
  ☆1,174Updated 3 months ago
• llm-merging / LLM-Merging
  LLM-Merging: Building LLMs Efficiently through Merging
  ☆191Updated 5 months ago
• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆197Updated last year
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆334Updated 5 months ago
• srush / LLM-Training-Puzzles
  What would you do with 1000 H100s...
  ☆1,011Updated last year
• neubig / anlp-code
  ☆172Updated last year
• alon-albalak / data-selection-survey
  A Survey on Data Selection for Language Models
  ☆213Updated 4 months ago
• microsoft / rho
  Repo for Rho-1: Token-level Data Selection & Selective Pretraining of LLMs.
  ☆400Updated 10 months ago
• ahmed-alllam / Direct-Preference-Optimization
  Direct Preference Optimization from scratch in PyTorch
  ☆84Updated last year
• lucidrains / speculative-decoding
  Explorations into some recent techniques surrounding speculative decoding
  ☆245Updated 2 months ago
• LambdaLabsML / distributed-training-guide
  Best practices & guides on how to write distributed pytorch training code
  ☆359Updated last week
• rwitten / HighPerfLLMs2024
  ☆394Updated 7 months ago
• okhat / blog
  ☆272Updated 5 months ago
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆54Updated 10 months ago
• yuandong-tian / arXiv_recbot
  A Telegram bot to recommend arXiv papers
  ☆249Updated 3 weeks ago
• allenai / reward-bench
  RewardBench: the first evaluation tool for reward models.
  ☆518Updated this week
• gpu-mode / ring-attention
  ring-attention experiments
  ☆126Updated 4 months ago
• FranxYao / Long-Context-Data-Engineering
  Implementation of paper Data Engineering for Scaling Language Models to 128K Context
  ☆452Updated 11 months ago