HazyResearch / TART
TART: A plug-and-play Transformer module for task-agnostic reasoning
☆195Updated last year
Alternatives and similar repositories for TART:
Users that are interested in TART are comparing it to the libraries listed below
- Code repository for the c-BTM paper☆106Updated last year
- ModuleFormer is a MoE-based architecture that includes two different types of experts: stick-breaking attention heads and feedforward exp…☆217Updated 11 months ago
- Simple next-token-prediction for RLHF☆222Updated last year
- ☆130Updated last year
- Multipack distributed sampler for fast padding-free training of LLMs☆186Updated 7 months ago
- ☆94Updated last year
- ☆159Updated 2 years ago
- Self-Alignment with Principle-Following Reward Models☆156Updated last year
- Inspecting and Editing Knowledge Representations in Language Models☆112Updated last year
- Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.☆162Updated last year
- Reverse Instructions to generate instruction tuning data with corpus examples☆208Updated last year
- ☆93Updated 3 months ago
- ☆172Updated last year
- Exploring finetuning public checkpoints on filter 8K sequences on Pile☆115Updated last year
- Load multiple LoRA modules simultaneously and automatically switch the appropriate combination of LoRA modules to generate the best answe…☆150Updated last year
- [ICLR 2023] Guess the Instruction! Flipped Learning Makes Language Models Stronger Zero-Shot Learners☆113Updated 6 months ago
- Scripts for generating synthetic finetuning data for reducing sycophancy.☆109Updated last year
- Learning to Compress Prompts with Gist Tokens - https://arxiv.org/abs/2304.08467☆279Updated last month
- The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"☆108Updated last year
- The GitHub repo for Goal Driven Discovery of Distributional Differences via Language Descriptions☆69Updated last year
- Spherical Merge Pytorch/HF format Language Models with minimal feature loss.☆117Updated last year
- Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"☆81Updated last year
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆126Updated last year
- Code of ICLR paper: https://openreview.net/forum?id=-cqvvvb-NkI☆94Updated 2 years ago
- Code for the paper "The Impact of Positional Encoding on Length Generalization in Transformers", NeurIPS 2023☆130Updated 10 months ago
- The official repo for "LLoCo: Learning Long Contexts Offline"☆115Updated 9 months ago
- Flacuna was developed by fine-tuning Vicuna on Flan-mini, a comprehensive instruction collection encompassing various tasks. Vicuna is al…☆111Updated last year
- Code release for Dataless Knowledge Fusion by Merging Weights of Language Models (https://openreview.net/forum?id=FCnohuR6AnM)☆87Updated last year
- A repository for transformer critique learning and generation☆89Updated last year
- ☆412Updated last year