Alternatives and similar repositories for transformer-heads

Users that are interested in transformer-heads are comparing it to the libraries listed below

• Locutusque / TPU-Alignment
  Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free
  ☆231Updated 11 months ago
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆262Updated 10 months ago
• arcee-ai / DALM
  Domain Adapted Language Modeling Toolkit - E2E RAG
  ☆329Updated 11 months ago
• QuixiAI / spectrum
  ☆136Updated 2 months ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆273Updated last year
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆302Updated 3 months ago
• lamini-ai / Lamini-Memory-Tuning
  Banishing LLM Hallucinations Requires Rethinking Generalization
  ☆275Updated last year
• QuixiAI / laserRMT
  This is our own implementation of 'Layer Selective Rank Reduction'
  ☆239Updated last year
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆240Updated 11 months ago
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆110Updated last year
• mlabonne / llm-autoeval
  Automatically evaluate your LLMs in Google Colab
  ☆660Updated last year
• Pints-AI / 1.5-Pints
  A compact LLM pretrained in 9 days by using high quality data
  ☆330Updated 6 months ago
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆38Updated last year
• writer / writing-in-the-margins
  ☆119Updated last year
• jxmorris12 / cde
  code for training & evaluating Contextual Document Embedding models
  ☆198Updated 5 months ago
• huggingface / text-clustering
  Easily embed, cluster and semantically label text datasets
  ☆578Updated last year
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆50Updated last year
• allenai / fm-cheatsheet
  Website for hosting the Open Foundation Models Cheat Sheet.
  ☆267Updated 5 months ago
• Mihaiii / llm_steer
  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…
  ☆246Updated 8 months ago
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers models
  ☆177Updated last year
• ayulockin / neurips-llm-efficiency-challenge
  Starter pack for NeurIPS LLM Efficiency Challenge 2023.
  ☆126Updated 2 years ago
• muellerzr / minimal-trainer-zoo
  Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines
  ☆195Updated last year
• deep-diver / llamaduo
  [ACL'25] Official Code for LlamaDuo: LLMOps Pipeline for Seamless Migration from Service LLMs to Small-Scale Local LLMs
  ☆314Updated 3 months ago
• cohere-ai / DiskVectorIndex
  ☆210Updated 3 months ago
• Leeroo-AI / mergoo
  A library for easily merging multiple LLM experts, and efficiently train the merged LLM.
  ☆494Updated last year
• jondurbin / bagel
  A bagel, with everything.
  ☆324Updated last year
• argilla-io / notus
  Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first app…
  ☆169Updated last year
• IBM / fastfit
  FastFit ⚡ When LLMs are Unfit Use FastFit ⚡ Fast and Effective Text Classification with Many Classes
  ☆212Updated last month
• MoritzLaurer / zeroshot-classifier
  Notebooks for training universal 0-shot classifiers on many different tasks
  ☆136Updated 9 months ago
• bobazooba / xllm
  🦖 X—LLM: Cutting Edge & Easy LLM Finetuning
  ☆406Updated last year