huggingface / transformers-research-projectsLinks
Research projects built on top of Transformers
☆100Updated 8 months ago
Alternatives and similar repositories for transformers-research-projects
Users that are interested in transformers-research-projects are comparing it to the libraries listed below
Sorting:
- The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".☆180Updated last week
- LoRA and DoRA from Scratch Implementations☆214Updated last year
- ☆208Updated 3 weeks ago
- Code for Zero-Shot Tokenizer Transfer☆141Updated 10 months ago
- A set of scripts and notebooks on LLM finetunning and dataset creation☆111Updated last year
- MatFormer repo☆65Updated 11 months ago
- minimal GRPO implementation from scratch☆99Updated 8 months ago
- Implementation of CALM from the paper "LLM Augmented LLMs: Expanding Capabilities through Composition", out of Google Deepmind☆177Updated last year
- An extension of the nanoGPT repository for training small MOE models.☆212Updated 8 months ago
- code for training & evaluating Contextual Document Embedding models☆200Updated 6 months ago
- Let's build better datasets, together!☆264Updated 11 months ago
- Notes on Direct Preference Optimization☆23Updated last year
- ☆200Updated 11 months ago
- A simplified implementation for experimenting with RLVR on GSM8K, This repository provides a starting point for exploring reasoning.☆145Updated 9 months ago
- The official evaluation suite and dynamic data release for MixEval.☆253Updated last year
- Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024☆346Updated 6 months ago
- ⏰ AI conference deadline countdowns☆288Updated last week
- [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning☆363Updated last year
- Toolkit for attaching, training, saving and loading of new heads for transformer models☆291Updated 8 months ago
- Official repository for ORPO☆465Updated last year
- Prune transformer layers☆74Updated last year
- dLLM: Simple Diffusion Language Modeling☆950Updated last week
- Google TPU optimizations for transformers models☆122Updated 10 months ago
- LongRoPE is a novel method that can extends the context window of pre-trained LLMs to an impressive 2048k tokens.☆271Updated 3 weeks ago
- ☆45Updated 5 months ago
- Reproduction of DeepSeek-R1☆243Updated 7 months ago
- EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…☆242Updated last year
- From scratch implementation of a vision language model in pure PyTorch☆250Updated last year
- Conference schedule, top papers, and analysis of the data for NeurIPS 2023!☆121Updated last year
- Manage scalable open LLM inference endpoints in Slurm clusters☆277Updated last year