Alternatives and similar repositories for transformers-research-projects

Users that are interested in transformers-research-projects are comparing it to the libraries listed below

• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆215Updated last year
• huggingface / fineweb-2
  ☆209Updated last month
• CASE-Lab-UMD / LLM-Drop
  The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".
  ☆185Updated last month
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆100Updated 9 months ago
• lucidrains / CALM-pytorch
  Implementation of CALM from the paper "LLM Augmented LLMs: Expanding Capabilities through Composition", out of Google Deepmind
  ☆179Updated last year
• wolfecameron / nanoMoE
  An extension of the nanoGPT repository for training small MOE models.
  ☆216Updated 9 months ago
• facebookresearch / LayerSkip
  Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024
  ☆349Updated 7 months ago
• shangshang-wang / Tina
  Tina: Tiny Reasoning Models via LoRA
  ☆309Updated 2 months ago
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆245Updated last year
• bminixhofer / zett
  Code for Zero-Shot Tokenizer Transfer
  ☆142Updated 11 months ago
• tianyi-lab / Reflection_Tuning
  [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning
  ☆366Updated last year
• devvrit / matformer
  MatFormer repo
  ☆66Updated last year
• huggingface / gpt-oss-recipes
  Collection of scripts and notebooks for OpenAI's latest GPT OSS models
  ☆481Updated 3 months ago
• Mohammadjafari80 / GSM8K-RLVR
  A simplified implementation for experimenting with RLVR on GSM8K, This repository provides a starting point for exploring reasoning.
  ☆148Updated 10 months ago
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆124Updated 10 months ago
• NVlabs / hymba
  ☆205Updated last year
• ByungKwanLee / DeepSick-R1
  Reproduction of DeepSeek-R1
  ☆244Updated 8 months ago
• huggingface / data-is-better-together
  Let's build better datasets, together!
  ☆265Updated 11 months ago
• microsoft / LongRoPE
  LongRoPE is a novel method that can extends the context window of pre-trained LLMs to an impressive 2048k tokens.
  ☆275Updated last month
• jxmorris12 / cde
  code for training & evaluating Contextual Document Embedding models
  ☆201Updated 7 months ago
• tcapelle / llm_recipes
  A set of scripts and notebooks on LLM finetunning and dataset creation
  ☆112Updated last year
• huggingface / ai-deadlines
  ⏰ AI conference deadline countdowns
  ☆291Updated last week
• writer / writing-in-the-margins
  ☆120Updated last year
• Jaykef / ai-algorithms
  First-principle implementations of groundbreaking AI algorithms using a wide range of deep learning frameworks, accompanied by supporting…
  ☆180Updated 4 months ago
• xfactlab / orpo
  Official repository for ORPO
  ☆467Updated last year
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆253Updated last year
• lucidrains / llama-qrlhf
  Implementation of the Llama architecture with RLHF + Q-learning
  ☆168Updated 10 months ago
• kongds / MoRA
  MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning
  ☆361Updated last year
• huggingface / lm-evaluation-harness
  A framework for few-shot evaluation of language models.
  ☆35Updated 8 months ago
• NVIDIA-NeMo / Skills
  A project to improve skills of large language models
  ☆648Updated last week