Alternatives and similar repositories for transformers-research-projects

Users that are interested in transformers-research-projects are comparing it to the libraries listed below

• lucidrains / CALM-pytorch
  Implementation of CALM from the paper "LLM Augmented LLMs: Expanding Capabilities through Composition", out of Google Deepmind
  ☆177Updated last year
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆263Updated 10 months ago
• CASE-Lab-UMD / LLM-Drop
  The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".
  ☆179Updated 7 months ago
• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆211Updated last year
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆140Updated 9 months ago
• huggingface / fineweb-2
  ☆201Updated last week
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆98Updated 7 months ago
• jxmorris12 / cde
  code for training & evaluating Contextual Document Embedding models
  ☆199Updated 5 months ago
• Mohammadjafari80 / GSM8K-RLVR
  A simplified implementation for experimenting with RLVR on GSM8K, This repository provides a starting point for exploring reasoning.
  ☆136Updated 8 months ago
• huggingface / ai-deadlines
  ⏰ AI conference deadline countdowns
  ☆285Updated 2 weeks ago
• daniel-furman / sft-demos
  Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.
  ☆78Updated last year
• facebookresearch / LayerSkip
  Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024
  ☆344Updated 6 months ago
• jakespringer / echo-embeddings
  ☆155Updated last year
• xfactlab / orpo
  Official repository for ORPO
  ☆463Updated last year
• melisa-writer / short-transformers
  Prune transformer layers
  ☆69Updated last year
• llm-merging / LLM-Merging
  LLM-Merging: Building LLMs Efficiently through Merging
  ☆204Updated last year
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆205Updated 7 months ago
• huggingface / competitions
  ☆124Updated last year
• huggingface / lm-evaluation-harness
  A framework for few-shot evaluation of language models.
  ☆35Updated 7 months ago
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆110Updated last year
• alperiox / Compact-Language-Models-via-Pruning-and-Knowledge-Distillation
  Unofficial implementation of https://arxiv.org/pdf/2407.14679
  ☆50Updated last year
• tianyi-lab / Reflection_Tuning
  [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning
  ☆363Updated last year
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆240Updated last year
• catid / dora
  Implementation of DoRA
  ☆304Updated last year
• neubig / minllama-assignment
  ☆98Updated last year
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆273Updated last year
• shangshang-wang / Tina
  Tina: Tiny Reasoning Models via LoRA
  ☆302Updated last month
• sanyalsunny111 / LLM-Inheritune
  This is the official repository for Inheritune.
  ☆115Updated 8 months ago
• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆117Updated 2 years ago
• writer / writing-in-the-margins
  ☆119Updated last year