apple / ml-selfcondLinks
Self-Conditioning Pre-Trained Language Models, ICML 2022
☆34Updated 3 years ago
Alternatives and similar repositories for ml-selfcond
Users that are interested in ml-selfcond are comparing it to the libraries listed below
Sorting:
- Whispering Experts: Neural Interventions for Toxicity Mitigation in Language Models, ICML 2024☆24Updated last year
- SILO Language Models code repository☆83Updated last year
- This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…☆31Updated 2 years ago
- ☆56Updated last year
- Experiments for efforts to train a new and improved t5☆76Updated last year
- Code for Zero-Shot Tokenizer Transfer☆142Updated 10 months ago
- OSLO: Open Source for Large-scale Optimization☆174Updated 2 years ago
- Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model☆45Updated 2 months ago
- Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*☆87Updated last year
- ☆42Updated 3 years ago
- MEXMA: Token-level objectives improve sentence representations☆42Updated 11 months ago
- Repo for "Smart Word Suggestions" (SWS) task and benchmark☆20Updated 2 years ago
- **ARCHIVED** Filesystem interface to 🤗 Hub☆58Updated 2 years ago
- Hugging Face Download (Cache) Manager☆21Updated 3 years ago
- some common Huggingface transformers in maximal update parametrization (µP)☆87Updated 3 years ago
- ☆150Updated last year
- ☆19Updated 3 years ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆60Updated last year
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.☆96Updated 2 years ago
- ☆23Updated 3 years ago
- The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …☆60Updated last year
- This repository contains code for cleaning your training data of benchmark data to help combat data snooping.☆27Updated 2 years ago
- ☆76Updated last year
- [ACL 2023] Gradient Ascent Post-training Enhances Language Model Generalization☆29Updated last year
- ☆44Updated last year
- ☆16Updated last year
- Code for the ACL 2023 paper: "Rethinking the Role of Scale for In-Context Learning: An Interpretability-based Case Study at 66 Billion Sc…☆35Updated 2 years ago
- Developing tools to automatically analyze datasets☆75Updated last year
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆35Updated 2 years ago
- URL downloader supporting checkpointing and continuous checksumming.☆19Updated 2 years ago