pytorch / torchtune

Related projects ⓘ

Alternatives and complementary repositories for torchtune

• arcee-ai / mergekit
  Tools for merging pretrained large language models.
  ☆4,788Updated this week
• sgl-project / sglang
  SGLang is a fast serving framework for large language models and vision language models.
  ☆5,919Updated this week
• pytorch / torchtitan
  A native PyTorch Library for large model training
  ☆2,566Updated this week
• pytorch-labs / gpt-fast
  Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.
  ☆5,647Updated 3 weeks ago
• EleutherAI / lm-evaluation-harness
  A framework for few-shot evaluation of language models.
  ☆6,904Updated this week
• axolotl-ai-cloud / axolotl
  Go ahead and axolotl questions
  ☆7,858Updated this week
• pytorch / torchchat
  Run PyTorch LLMs locally on servers, desktop and mobile
  ☆3,350Updated this week
• mlabonne / llm-datasets
  High-quality datasets, tools, and concepts for LLM fine-tuning.
  ☆1,965Updated 2 weeks ago
• Lightning-AI / litgpt
  20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
  ☆10,590Updated this week
• huggingface / alignment-handbook
  Robust recipes to align language models with human and AI preferences
  ☆4,663Updated last month
• openai / transformer-debugger
  ☆4,030Updated 5 months ago
• mistralai / mistral-finetune
  ☆2,732Updated last month
• bitsandbytes-foundation / bitsandbytes
  Accessible large language models via k-bit quantization for PyTorch.
  ☆6,244Updated this week
• huggingface / datatrove
  Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.
  ☆2,026Updated last week
• mit-han-lab / llm-awq
  [MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
  ☆2,498Updated 3 weeks ago
• linkedin / Liger-Kernel
  Efficient Triton Kernels for LLM Training
  ☆3,382Updated this week
• pytorch / ao
  PyTorch native quantization and sparsity for training and inference
  ☆1,541Updated this week
• InternLM / lmdeploy
  LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
  ☆4,593Updated this week
• predibase / lorax
  Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
  ☆2,178Updated this week
• jiaweizzhao / GaLore
  GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
  ☆1,426Updated last week
• meta-llama / llama-recipes
  Scripts for fine-tuning Meta Llama with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom dataset…
  ☆14,903Updated this week
• AnswerDotAI / fsdp_qlora
  Training LLMs with QLoRA + FSDP
  ☆1,419Updated this week
• NVIDIA / TensorRT-LLM
  TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain…
  ☆8,604Updated this week
• S-LoRA / S-LoRA
  S-LoRA: Serving Thousands of Concurrent LoRA Adapters
  ☆1,745Updated 9 months ago
• zou-group / textgrad
  TextGrad: Automatic ''Differentiation'' via Text -- using large language models to backpropagate textual gradients.
  ☆1,797Updated last week
• google / gemma_pytorch
  The official PyTorch implementation of Google's Gemma models
  ☆5,283Updated 3 months ago
• jzhang38 / TinyLlama
  The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.
  ☆7,835Updated 6 months ago
• huggingface / trl
  Train transformer language models with reinforcement learning.
  ☆9,967Updated this week
• unslothai / unsloth
  Finetune Llama 3.2, Mistral, Phi, Qwen & Gemma LLMs 2-5x faster with 80% less memory
  ☆17,884Updated this week
• facebookresearch / chameleon
  Repository for Meta Chameleon, a mixed-modal early-fusion foundation model from FAIR.
  ☆1,823Updated 3 months ago