rasbt / LLM-finetuning-scripts

Related projects ⓘ

Alternatives and complementary repositories for LLM-finetuning-scripts

• rajshah4 / LLM-Evaluation
  Sample notebooks and prompts for LLM evaluation
  ☆114Updated this week
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆93Updated last month
• muellerzr / minimal-trainer-zoo
  Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines
  ☆195Updated 6 months ago
• center-for-humans-and-machines / transformer-heads
  Toolkit for attaching, training, saving and loading of new heads for transformer models
  ☆246Updated 2 weeks ago
• ayulockin / neurips-llm-efficiency-challenge
  Starter pack for NeurIPS LLM Efficiency Challenge 2023.
  ☆118Updated last year
• alopatenko / LLMEvaluation
  A comprehensive guide to LLM evaluation methods designed to assist in identifying the most suitable evaluation techniques for various use…
  ☆66Updated this week
• eugeneyan / visualizing-finetunes
  ☆75Updated 5 months ago
• parlance-labs / ftcourse
  ☆162Updated 5 months ago
• FourthBrain / Building-with-Instruction-Tuned-LLMs-A-Step-by-Step-Guide
  Resources relating to the DLAI event: https://www.youtube.com/watch?v=eTieetk2dSw
  ☆181Updated last year
• huggingface / workshops
  Materials for workshops on the Hugging Face ecosystem
  ☆150Updated last year
• arcee-ai / DALM
  Domain Adapted Language Modeling Toolkit - E2E RAG
  ☆311Updated last week
• abacaj / train-with-fsdp
  ☆91Updated last year
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆205Updated this week
• predibase / llm_distillation_playbook
  Best practices for distilling large language models.
  ☆397Updated 9 months ago
• aniketmaurya / llm-inference
  Large Language Model (LLM) Inference API and Chatbot
  ☆122Updated 7 months ago
• Arize-ai / LLMTest_NeedleInAHaystack
  Doing simple retrieval from LLM models at various context lengths to measure accuracy
  ☆97Updated 7 months ago
• run-llama / finetune-embedding
  Fine-Tuning Embedding for RAG with Synthetic Data
  ☆469Updated last year
• jjallaire / inspect-llm-workshop
  ☆47Updated 5 months ago
• warner-benjamin / commented-transformers
  Highly commented implementations of Transformers in PyTorch
  ☆128Updated last year
• huggingface / large_language_model_training_playbook
  An open collection of implementation tips, tricks and resources for training large language models
  ☆460Updated last year
• AymenKallala / RAG_Maestro
  Building a chatbot powered with a RAG pipeline to read,summarize and quote the most relevant papers related to the user query.
  ☆162Updated 6 months ago
• huggingface / text-clustering
  Easily embed, cluster and semantically label text datasets
  ☆462Updated 7 months ago
• Locutusque / TPU-Alignment
  Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free
  ☆221Updated 2 weeks ago
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆105Updated 5 months ago
• Preemo-Inc / text-generation-inference
  ☆200Updated 9 months ago
• SumanthRH / tokenization
  A comprehensive deep dive into the world of tokens
  ☆214Updated 4 months ago
• TrelisResearch / install-guides
  Various installation guides for Large Language Models
  ☆53Updated last week
• facebookresearch / belebele
  Repo for the Belebele dataset, a massively multilingual reading comprehension dataset.
  ☆315Updated 3 months ago
• AblateIt / finetune-study
  Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.
  ☆81Updated last year
• anakin87 / mistral-haystack
  Mistral + Haystack: build RAG pipelines that rock 🤘
  ☆100Updated 9 months ago