Alternatives and similar repositories for LLM-Workshop

Users that are interested in LLM-Workshop are comparing it to the libraries listed below

• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆110Updated last year
• predibase / llm_distillation_playbook
  Best practices for distilling large language models.
  ☆576Updated last year
• mlabonne / llm-autoeval
  Automatically evaluate your LLMs in Google Colab
  ☆661Updated last year
• xfactlab / orpo
  Official repository for ORPO
  ☆464Updated last year
• llm-efficiency-challenge / neurips_llm_efficiency_challenge
  NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
  ☆256Updated last year
• huggingface / llm_training_handbook
  An open collection of methodologies to help with successful training of large language models.
  ☆512Updated last year
• huggingface / cosmopedia
  ☆541Updated 10 months ago
• ayulockin / neurips-llm-efficiency-challenge
  Starter pack for NeurIPS LLM Efficiency Challenge 2023.
  ☆126Updated 2 years ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆274Updated last year
• jondurbin / bagel
  A bagel, with everything.
  ☆324Updated last year
• VikParuchuri / textbook_quality
  Generate textbook-quality synthetic LLM pretraining data
  ☆505Updated last year
• sabetAI / BLoRA
  batched loras
  ☆346Updated 2 years ago
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆297Updated 3 months ago
• tomaarsen / attention_sinks
  Extend existing LLMs way beyond the original training length with constant memory usage, without retraining
  ☆720Updated last year
• FastEval / FastEval
  Fast & more realistic evaluation of chat language models. Includes leaderboard.
  ☆189Updated last year
• huggingface / large_language_model_training_playbook
  An open collection of implementation tips, tricks and resources for training large language models
  ☆481Updated 2 years ago
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆249Updated 11 months ago
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆262Updated 9 months ago
• rasbt / LLM-finetuning-scripts
  ☆216Updated last year
• center-for-humans-and-machines / transformer-heads
  Toolkit for attaching, training, saving and loading of new heads for transformer models
  ☆288Updated 7 months ago
• Leeroo-AI / mergoo
  A library for easily merging multiple LLM experts, and efficiently train the merged LLM.
  ☆492Updated last year
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆240Updated 11 months ago
• huggingface / text-clustering
  Easily embed, cluster and semantically label text datasets
  ☆578Updated last year
• philschmid / easyllm
  ☆463Updated last year
• mlfoundations / open_lm
  A repository for research on medium sized language models.
  ☆511Updated 4 months ago
• HumanSignal / RLHF
  Collection of links, tutorials and best practices of how to collect the data and build end-to-end RLHF system to finetune Generative AI m…
  ☆223Updated 2 years ago
• SumanthRH / tokenization
  A comprehensive deep dive into the world of tokens
  ☆226Updated last year
• lm-sys / llm-decontaminator
  Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"
  ☆311Updated last year
• Locutusque / TPU-Alignment
  Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free
  ☆231Updated 11 months ago
• epfLLM / Megatron-LLM
  distributed trainer for LLMs
  ☆580Updated last year