Alternatives and similar repositories for ml-engineering

Users that are interested in ml-engineering are comparing it to the libraries listed below

• Lightning-AI / litgpt
  20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
  ☆13,137Updated this week
• meta-pytorch / torchtune
  PyTorch native post-training library
  ☆5,660Updated last week
• axolotl-ai-cloud / axolotl
  Go ahead and axolotl questions
  ☆11,251Updated this week
• naklecha / llama3-from-scratch
  llama3 implementation one matrix multiplication at a time
  ☆15,241Updated last year
• meta-pytorch / gpt-fast
  Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.
  ☆6,183Updated 5 months ago
• pytorch / torchtitan
  A PyTorch native platform for training generative AI models
  ☆5,045Updated this week
• openai / transformer-debugger
  ☆4,112Updated last year
• Dao-AILab / flash-attention
  Fast and memory-efficient exact attention
  ☆22,113Updated this week
• karpathy / minbpe
  Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
  ☆10,293Updated last year
• gpu-mode / lectures
  Material for gpu-mode lectures
  ☆5,679Updated last week
• srush / Tensor-Puzzles
  Solve puzzles. Improve your pytorch.
  ☆3,912Updated last year
• bitsandbytes-foundation / bitsandbytes
  Accessible large language models via k-bit quantization for PyTorch.
  ☆7,939Updated 2 weeks ago
• huggingface / trl
  Train transformer language models with reinforcement learning.
  ☆17,297Updated this week
• EleutherAI / lm-evaluation-harness
  A framework for few-shot evaluation of language models.
  ☆11,358Updated this week
• Mooler0410 / LLMsPracticalGuide
  A curated list of practical guide resources of LLMs (LLMs Tree, Examples, Papers)
  ☆10,146Updated last year
• srush / Triton-Puzzles
  Puzzles for learning Triton
  ☆2,283Updated last year
• mlabonne / llm-course
  Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.
  ☆74,415Updated last month
• Hannibal046 / Awesome-LLM
  Awesome-LLM: a curated list of Large Language Model
  ☆26,195Updated 6 months ago
• arcee-ai / mergekit
  Tools for merging pretrained large language models.
  ☆6,761Updated last week
• ashishpatel26 / LLM-Finetuning
  LLM Finetuning with peft
  ☆2,762Updated 6 months ago
• triton-lang / triton
  Development repository for the Triton language and compiler
  ☆18,319Updated last week
• karpathy / LLM101n
  LLM101n: Let's build a Storyteller
  ☆36,254Updated last year
• huggingface / alignment-handbook
  Robust recipes to align language models with human and AI preferences
  ☆5,489Updated 5 months ago
• huggingface / text-generation-inference
  Large Language Model Text Generation Inference
  ☆10,749Updated last month
• allenai / OLMo
  Modeling, training, eval, and inference code for OLMo
  ☆6,305Updated 2 months ago
• hijkzzz / Awesome-LLM-Strawberry
  A collection of LLM papers, blogs, and projects, with a focus on OpenAI o1 🍓 and reasoning techniques.
  ☆6,893Updated last month
• NielsRogge / Transformers-Tutorials
  This repository contains demos I made with the Transformers library by HuggingFace.
  ☆11,490Updated 3 weeks ago
• tensorchord / Awesome-LLMOps
  An awesome & curated list of best LLMOps tools for developers
  ☆5,590Updated this week
• mlabonne / llm-datasets
  Curated list of datasets and tools for post-training.
  ☆4,229Updated 2 months ago
• ggml-org / ggml
  Tensor library for machine learning
  ☆13,923Updated this week