Alternatives and similar repositories for transformer-heads:

Users that are interested in transformer-heads are comparing it to the libraries listed below

• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆259Updated 4 months ago
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆255Updated 9 months ago
• Locutusque / TPU-Alignment
  Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free
  ☆231Updated 6 months ago
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆278Updated 6 months ago
• cognitivecomputations / spectrum
  ☆117Updated last month
• muellerzr / minimal-trainer-zoo
  Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines
  ☆198Updated last year
• cognitivecomputations / laserRMT
  This is our own implementation of 'Layer Selective Rank Reduction'
  ☆237Updated 11 months ago
• lightonai / pylate
  Late Interaction Models Training & Retrieval
  ☆306Updated this week
• lamini-ai / Lamini-Memory-Tuning
  Banishing LLM Hallucinations Requires Rethinking Generalization
  ☆273Updated 9 months ago
• jxmorris12 / cde
  code for training & evaluating Contextual Document Embedding models
  ☆183Updated 3 weeks ago
• jondurbin / bagel
  A bagel, with everything.
  ☆320Updated last year
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆215Updated 6 months ago
• arcee-ai / DALM
  Domain Adapted Language Modeling Toolkit - E2E RAG
  ☆320Updated 6 months ago
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆104Updated 11 months ago
• IBM / fastfit
  FastFit ⚡ When LLMs are Unfit Use FastFit ⚡ Fast and Effective Text Classification with Many Classes
  ☆202Updated this week
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆108Updated 7 months ago
• cohere-ai / DiskVectorIndex
  ☆210Updated 10 months ago
• sileod / tasksource
  Datasets collection and preprocessings framework for NLP extreme multitask learning
  ☆180Updated 4 months ago
• cognitivecomputations / grokadamw
  ☆129Updated 8 months ago
• ayulockin / neurips-llm-efficiency-challenge
  Starter pack for NeurIPS LLM Efficiency Challenge 2023.
  ☆124Updated last year
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆37Updated last year
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers models
  ☆173Updated last year
• allenai / fm-cheatsheet
  Website for hosting the Open Foundation Models Cheat Sheet.
  ☆267Updated 3 weeks ago
• SumanthRH / tokenization
  A comprehensive deep dive into the world of tokens
  ☆222Updated 10 months ago
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆76Updated 6 months ago
• Knowledgator / GLiClass
  Generalist and Lightweight Model for Text Classification
  ☆124Updated last week
• pacman100 / openhathi_instruct
  This repository contains the code for dataset curation and finetuning of instruct variant of the Bilingual OpenHathi model. The resultin…
  ☆23Updated last year
• AnswerDotAI / fastdata
  ☆151Updated 5 months ago
• VITA-Group / Q-GaLore
  Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
  ☆199Updated 9 months ago
• huggingface / text-clustering
  Easily embed, cluster and semantically label text datasets
  ☆530Updated last year