Yuanhy1997 / HyPe
HyPe: Better Pre-trained Language Model Fine-tuning with Hidden Representation Perturbation [ACL 2023]
☆14Updated last year
Alternatives and similar repositories for HyPe:
Users that are interested in HyPe are comparing it to the libraries listed below
- Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification☆11Updated last year
- Implementation of the model: "Reka Core, Flash, and Edge: A Series of Powerful Multimodal Language Models" in PyTorch☆30Updated last month
- Embedding Recycling for Language models☆38Updated last year
- Minimum Description Length probing for neural network representations☆19Updated last month
- Starbucks: Improved Training for 2D Matryoshka Embeddings☆18Updated last month
- This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…☆31Updated last year
- Repository for Skill Set Optimization☆12Updated 7 months ago
- ☆18Updated 9 months ago
- Adding new tasks to T0 without catastrophic forgetting☆33Updated 2 years ago
- Official code repo for paper "Great Memory, Shallow Reasoning: Limits of kNN-LMs"☆22Updated 6 months ago
- [NeurIPS 2023] Sparse Modular Activation for Efficient Sequence Modeling☆36Updated last year
- ☆21Updated last month
- A package for fine tuning of pretrained NLP transformers using Semi Supervised Learning☆15Updated 3 years ago
- Few-shot Learning with Auxiliary Data☆27Updated last year
- ☆13Updated 2 weeks ago
- Efficient Scaling laws and collaborative pretraining.☆15Updated last month
- This repository contains some of the code used in the paper "Training Language Models with Langauge Feedback at Scale"☆27Updated last year
- Repo for "Zemi: Learning Zero-Shot Semi-Parametric Language Models from Multiple Tasks" ACL 2023 Findings☆16Updated last year
- Learning to Model Editing Processes☆26Updated 2 years ago
- Tasks for describing differences between text distributions.☆16Updated 7 months ago
- official repo of AAAI2024 paper Mitigating the Impact of False Negatives in Dense Retrieval with Contrastive Confidence Regularization☆13Updated last year
- Aioli: A unified optimization framework for language model data mixing☆22Updated 2 months ago
- Fine-Tuning Pre-trained Transformers into Decaying Fast Weights☆19Updated 2 years ago
- An attempt to merge ESBN with Transformers, to endow Transformers with the ability to emergently bind symbols☆15Updated 3 years ago
- This repository contains the ToolSelect dataset which was used to fine-tune Llama-2 70B for tool selection.☆20Updated last year
- Code repo for "Model-Generated Pretraining Signals Improves Zero-Shot Generalization of Text-to-Text Transformers" (ACL 2023)☆22Updated last year
- Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model☆42Updated last year
- efficient query encoding for dense retrieval☆11Updated 7 months ago
- ☆25Updated last year
- A python library for highly configurable transformers - easing model architecture search and experimentation.☆49Updated 3 years ago