Alternatives and similar repositories for transformers-research-projects

Users that are interested in transformers-research-projects are comparing it to the libraries listed below

• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆215Updated last year
• huggingface / fineweb-2
  ☆219Updated 3 months ago
• Mohammadjafari80 / GSM8K-RLVR
  A simplified implementation for experimenting with RLVR on GSM8K, This repository provides a starting point for exploring reasoning.
  ☆158Updated 11 months ago
• tianyi-lab / Reflection_Tuning
  [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning
  ☆366Updated last year
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆269Updated last year
• shangshang-wang / Tina
  Tina: Tiny Reasoning Models via LoRA
  ☆316Updated 4 months ago
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆142Updated last year
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆102Updated 10 months ago
• facebookresearch / LayerSkip
  Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024
  ☆355Updated last week
• lucidrains / CALM-pytorch
  Implementation of CALM from the paper "LLM Augmented LLMs: Expanding Capabilities through Composition", out of Google Deepmind
  ☆179Updated last year
• CASE-Lab-UMD / LLM-Drop
  The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".
  ☆188Updated 2 months ago
• jxmorris12 / cde
  code for training & evaluating Contextual Document Embedding models
  ☆202Updated 8 months ago
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆233Updated 10 months ago
• NVIDIA / logits-processor-zoo
  A collection of LogitsProcessors to customize and enhance LLM behavior for specific tasks.
  ☆382Updated 6 months ago
• huggingface / gpt-oss-recipes
  Collection of scripts and notebooks for OpenAI's latest GPT OSS models
  ☆496Updated 5 months ago
• huggingface / ai-deadlines
  ⏰ AI conference deadline countdowns
  ☆320Updated this week
• allenai / OLMo-core
  PyTorch building blocks for the OLMo ecosystem
  ☆763Updated this week
• llm-merging / LLM-Merging
  LLM-Merging: Building LLMs Efficiently through Merging
  ☆209Updated last year
• microsoft / LongRoPE
  LongRoPE is a novel method that can extends the context window of pre-trained LLMs to an impressive 2048k tokens.
  ☆276Updated 3 months ago
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆249Updated last year
• xfactlab / orpo
  Official repository for ORPO
  ☆469Updated last year
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆279Updated last year
• melisa-writer / short-transformers
  Prune transformer layers
  ☆74Updated last year
• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆122Updated 2 years ago
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆331Updated this week
• lucidrains / coconut-pytorch
  Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch
  ☆182Updated 7 months ago
• Jaykef / ai-algorithms
  First-principle implementations of groundbreaking AI algorithms using a wide range of deep learning frameworks, accompanied by supporting…
  ☆181Updated 6 months ago
• huggingface / lm-evaluation-harness
  A framework for few-shot evaluation of language models.
  ☆35Updated 10 months ago
• NVIDIA-NeMo / Skills
  A project to improve skills of large language models
  ☆804Updated this week
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆135Updated last week