Official repository of NEFTune: Noisy Embeddings Improves Instruction Finetuning
☆412May 17, 2024Updated 2 years ago
Alternatives and similar repositories for NEFTune
Users that are interested in NEFTune are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official implementation of GOAT model (ICML2023)☆38Jul 3, 2023Updated 3 years ago
- The official repository of the paper "On the Exploitability of Instruction Tuning".☆71Feb 5, 2024Updated 2 years ago
- Official repo for Detecting, Explaining, and Mitigating Memorization in Diffusion Models (ICLR 2024)☆78Apr 3, 2024Updated 2 years ago
- Generating Potent Poisons and Backdoors from Scratch with Guided Diffusion☆11Apr 1, 2024Updated 2 years ago
- Deita: Data-Efficient Instruction Tuning for Alignment [ICLR2024]☆609Dec 9, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"☆108Sep 23, 2023Updated 3 years ago
- What do we learn from inverting CLIP models?☆58Mar 6, 2024Updated 2 years ago
- Gemstones: A Model Suite for Multi-Faceted Scaling Laws (NeurIPS 2025)☆35Sep 28, 2025Updated last year
- Official Pytorch repo of CVPR'23 and NeurIPS'23 papers on understanding replication in diffusion models.☆114Nov 22, 2023Updated 2 years ago
- A simple and efficient baseline for data attribution☆11Nov 10, 2023Updated 2 years ago
- Robust recipes to align language models with human and AI preferences☆5,711Sep 23, 2026Updated last month
- ☆33Nov 27, 2023Updated 2 years ago
- [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs☆99Nov 17, 2024Updated last year
- ☆24Jan 27, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads☆2,774Jun 25, 2024Updated 2 years ago
- A large-scale, fine-grained, diverse preference dataset (and models).☆374Dec 29, 2023Updated 2 years ago
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆62Jun 21, 2023Updated 3 years ago
- Code for "DynaGuard: A Dynamic Guardrail Model With User-Defined Policies."☆25Nov 3, 2025Updated last year
- Code and documents of LongLoRA and LongAlpaca (ICLR 2024 Oral)☆2,684Aug 14, 2024Updated 2 years ago
- Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)☆200May 28, 2024Updated 2 years ago
- ☆18Oct 12, 2022Updated 4 years ago
- Tools for merging pretrained large language models.☆7,436Oct 31, 2026Updated last week
- This is the official repo for "Refusal Tokens: A Simple Way to Calibrate Refusals in Large Language Models"☆11Jul 22, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Code for fine-tuning Platypus fam LLMs using LoRA☆624Feb 4, 2024Updated 2 years ago
- Xwin-LM: Powerful, Stable, and Reproducible LLM Alignment☆1,037May 31, 2024Updated 2 years ago
- Reference implementation for DPO (Direct Preference Optimization)☆2,922Aug 11, 2024Updated 2 years ago
- Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates☆477Apr 21, 2024Updated 2 years ago
- Scaling Data-Constrained Language Models☆352Jun 28, 2025Updated last year
- ☆279Oct 31, 2023Updated 3 years ago
- Instruction Tuning with GPT-4☆4,333Jun 11, 2023Updated 3 years ago
- ☆32May 21, 2026Updated 5 months ago
- Package to optimize Adversarial Attacks against (Large) Language Models with Varied Objectives☆70Feb 22, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- [NeurIPS 2024] SimPO: Simple Preference Optimization with a Reference-Free Reward☆963Feb 16, 2025Updated last year
- [ICLR 2024] Efficient Streaming Language Models with Attention Sinks☆7,276Jul 11, 2024Updated 2 years ago
- Code for Dayal Kalra's research internship on scalable curvature measures for neural networks.☆33Feb 3, 2026Updated 9 months ago
- [ACL 2024] Progressive LLaMA with Block Expansion.☆515May 20, 2024Updated 2 years ago
- [ICML'24] Data and code for our paper "Training-Free Long-Context Scaling of Large Language Models"☆451Oct 16, 2024Updated 2 years ago
- The official implementation of Self-Play Fine-Tuning (SPIN)☆1,256May 8, 2024Updated 2 years ago
- [ICLR 2025] Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing. Your efficient and high-quality synthetic data …☆900Mar 17, 2025Updated last year