huggingface / large_language_model_training_playbook

Related projects ⓘ

Alternatives and complementary repositories for large_language_model_training_playbook

• huggingface / llm_training_handbook
  An open collection of methodologies to help with successful training of large language models.
  ☆462Updated 9 months ago
• llm-efficiency-challenge / neurips_llm_efficiency_challenge
  NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
  ☆252Updated last year
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆321Updated last month
• zeno-ml / zeno-build
  Build, evaluate, understand, and fix LLM-based apps
  ☆485Updated 10 months ago
• philschmid / deep-learning-pytorch-huggingface
  ☆685Updated last month
• bigscience-workshop / t-zero
  Reproduce results and replicate training fo T0 (Multitask Prompted Training Enables Zero-Shot Task Generalization)
  ☆457Updated 2 years ago
• huggingface / cosmopedia
  ☆451Updated 3 weeks ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆236Updated 4 months ago
• akoksal / LongForm
  Reverse Instructions to generate instruction tuning data with corpus examples
  ☆206Updated 8 months ago
• tomaarsen / attention_sinks
  Extend existing LLMs way beyond the original training length with constant memory usage, without retraining
  ☆675Updated 7 months ago
• arielnlee / Platypus
  Code for fine-tuning Platypus fam LLMs using LoRA
  ☆623Updated 9 months ago
• LAION-AI / Open-Instruction-Generalist
  Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks
  ☆206Updated 10 months ago
• allenai / natural-instructions
  Expanding natural instructions
  ☆959Updated 11 months ago
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆93Updated last month
• bigscience-workshop / bigscience
  Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.
  ☆980Updated 3 months ago
• sabetAI / BLoRA
  batched loras
  ☆336Updated last year
• bigscience-workshop / xmtf
  Crosslingual Generalization through Multitask Finetuning
  ☆516Updated last month
• facebookresearch / atlas
  Code repository for supporting the paper "Atlas Few-shot Learning with Retrieval Augmented Language Models",(https//arxiv.org/abs/2208.03…
  ☆517Updated 11 months ago
• bigscience-workshop / data-preparation
  Code used for sourcing and cleaning the BigScience ROOTS corpus
  ☆306Updated last year
• Shark-NLP / OpenICL
  OpenICL is an open-source framework to facilitate research, development, and prototyping of in-context learning.
  ☆541Updated last year
• allenai / catwalk
  This project studies the performance and robustness of language models and task-adaptation methods.
  ☆141Updated 6 months ago
• r-three / t-few
  Code for T-Few from "Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning"
  ☆431Updated last year
• PiotrNawrot / nanoT5
  Fast & Simple repository for pre-training and fine-tuning T5-style models
  ☆970Updated 3 months ago
• salesforce / DialogStudio
  DialogStudio: Towards Richest and Most Diverse Unified Dataset Collection and Instruction-Aware Models for Conversational AI
  ☆478Updated 6 months ago
• lucidrains / PaLM-pytorch
  Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways
  ☆821Updated 2 years ago
• huggingface / text-clustering
  Easily embed, cluster and semantically label text datasets
  ☆462Updated 7 months ago
• rasbt / LLM-finetuning-scripts
  ☆191Updated 9 months ago
• CarperAI / cheese
  Used for adaptive human in the loop evaluation of language and embedding models.
  ☆304Updated last year
• allenai / tango
  Organize your experiments into discrete steps that can be cached and reused throughout the lifetime of your research project.
  ☆534Updated 5 months ago