huggingface / transformers-research-projectsLinks
Research projects built on top of Transformers
☆88Updated 7 months ago
Alternatives and similar repositories for transformers-research-projects
Users that are interested in transformers-research-projects are comparing it to the libraries listed below
Sorting:
- ☆195Updated 3 months ago
- The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".☆177Updated 6 months ago
- LoRA and DoRA from Scratch Implementations☆211Updated last year
- A simplified implementation for experimenting with RLVR on GSM8K, This repository provides a starting point for exploring reasoning.☆129Updated 8 months ago
- A set of scripts and notebooks on LLM finetunning and dataset creation☆110Updated last year
- Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024☆341Updated 5 months ago
- PyTorch building blocks for the OLMo ecosystem☆305Updated this week
- Implementation of CALM from the paper "LLM Augmented LLMs: Expanding Capabilities through Composition", out of Google Deepmind☆177Updated last year
- ☆43Updated last year
- code for training & evaluating Contextual Document Embedding models☆197Updated 4 months ago
- minimal GRPO implementation from scratch☆98Updated 6 months ago
- Let's build better datasets, together!☆262Updated 9 months ago
- A framework for few-shot evaluation of language models.☆35Updated 6 months ago
- [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning☆361Updated last year
- ☆155Updated last year
- Lightweight demos for finetuning LLMs. Powered by 🤗 transformers and open-source datasets.☆78Updated 11 months ago
- ⏰ AI conference deadline countdowns☆283Updated 2 weeks ago
- Collection of scripts and notebooks for OpenAI's latest GPT OSS models☆455Updated last month
- Official repository for ORPO☆463Updated last year
- Manage scalable open LLM inference endpoints in Slurm clusters☆273Updated last year
- ☆119Updated last year
- Reproducible, flexible LLM evaluations☆252Updated 3 months ago
- Code for Zero-Shot Tokenizer Transfer☆138Updated 8 months ago
- This is the repo for the paper "PANGEA: A FULLY OPEN MULTILINGUAL MULTIMODAL LLM FOR 39 LANGUAGES"☆112Updated 3 months ago
- EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…☆240Updated 11 months ago
- awesome synthetic (text) datasets☆297Updated 3 months ago
- An extension of the nanoGPT repository for training small MOE models.☆196Updated 7 months ago
- LongRoPE is a novel method that can extends the context window of pre-trained LLMs to an impressive 2048k tokens.☆260Updated last year
- Collection of links, tutorials and best practices of how to collect the data and build end-to-end RLHF system to finetune Generative AI m…☆222Updated 2 years ago
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…☆342Updated 10 months ago