tval2 / contextual-pruningLinks
Library to facilitate pruning of LLMs based on context
☆32Updated last year
Alternatives and similar repositories for contextual-pruning
Users that are interested in contextual-pruning are comparing it to the libraries listed below
Sorting:
- ☆54Updated 9 months ago
- The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models☆22Updated 9 months ago
- This is the official repository for Inheritune.☆112Updated 6 months ago
- ☆118Updated last year
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆60Updated last year
- A repository for research on medium sized language models.☆78Updated last year
- Official repo for NAACL 2024 Findings paper "LeTI: Learning to Generate from Textual Interactions."☆64Updated 2 years ago
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆34Updated last year
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆55Updated 6 months ago
- Data preparation code for Amber 7B LLM☆91Updated last year
- Data preparation code for CrystalCoder 7B LLM☆45Updated last year
- ☆77Updated last year
- Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"