alinlab / HOMERLinks
Official implementation of Hierarchical Context Merging: Better Long Context Understanding for Pre-trained LLMs (ICLR 2024).
โ44Updated last year
Alternatives and similar repositories for HOMER
Users that are interested in HOMER are comparing it to the libraries listed below
Sorting:
- [๐๐๐๐๐ ๐ ๐ข๐ง๐๐ข๐ง๐ ๐ฌ ๐๐๐๐ & ๐๐๐ ๐๐๐๐ ๐๐๐๐๐ ๐๐ซ๐๐ฅ] ๐๐ฏ๐ฉ๐ข๐ฏ๐ค๐ช๐ฏ๐จ ๐๐ข๐ต๐ฉ๐ฆ๐ฎ๐ข๐ต๐ช๐ค๐ข๐ญ ๐๐ฆ๐ข๐ด๐ฐ๐ฏ๐ช๐ฏโฆโ52Updated last year
- Code for paper "Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning"โ83Updated last year
- Online Adaptation of Language Models with a Memory of Amortized Contexts (NeurIPS 2024)โ67Updated last year
- Pytorch implementation for "Compressed Context Memory For Online Language Model Interaction" (ICLR'24)โ62Updated last year
- [NeurIPS 2024 Main Track] Code for the paper titled "Instruction Tuning With Loss Over Instructions"โ39Updated last year
- [NeurIPS-2024] ๐ Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623โ86Updated 11 months ago
- [NeurIPS 2024] Train LLMs with diverse system messages reflecting individualized preferences to generalize to unseen system messagesโ49Updated last month
- Long Context Extension and Generalization in LLMsโ60Updated last year
- Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"โ88Updated last year
- [ICLR 2024] This is the repository for the paper titled "DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning"โ96Updated last year
- [NeurIPS 2023] Make Your Pre-trained Model Reversible: From Parameter to Memory Efficient Fine-Tuningโ32Updated 2 years ago
- Code release for Dataless Knowledge Fusion by Merging Weights of Language Models (https://openreview.net/forum?id=FCnohuR6AnM)โ91Updated 2 years ago
- Let's Sample Step by Step: Adaptive-Consistency for Efficient Reasoning with LLMsโ39Updated last year
- This repository contains the code and data for the paper "VisOnlyQA: Large Vision Language Models Still Struggle with Visual Perception oโฆโ27Updated 2 months ago
- Official Code Repository for the paper "Knowledge-Augmented Reasoning Distillation for Small Language Models in Knowledge-intensive Tasksโฆโ40Updated 9 months ago
- Unofficial Implementation of Chain-of-Thought Reasoning Without Promptingโ33Updated last year
- Co-LLM: Learning to Decode Collaboratively with Multiple Language Modelsโ119Updated last year
- The git repository of Modular Prompted Chatbot paperโ35Updated 2 years ago
- [Technical Report] Official PyTorch implementation code for realizing the technical part of Phantom of Latent representing equipped with โฆโ61Updated 11 months ago
- Official code and dataset for our NAACL 2024 paper: DialogCC: An Automated Pipeline for Creating High-Quality Multi-modal Dialogue Dataseโฆโ13Updated last year
- Improving Language Understanding from Screenshots. Paper: https://arxiv.org/abs/2402.14073โ30Updated last year
- โ22Updated last month
- PASTA: Post-hoc Attention Steering for LLMsโ122Updated 9 months ago
- official repo for the paper "Learning From Mistakes Makes LLM Better Reasoner"โ58Updated last year
- SILO Language Models code repositoryโ82Updated last year
- Preference Learning for LLaVAโ49Updated 10 months ago
- โ190Updated last year
- Introducing Filtered Direct Preference Optimization (fDPO) that enhances language model alignment with human preferences by discarding loโฆโ16Updated 9 months ago
- IntructIR, a novel benchmark specifically designed to evaluate the instruction following ability in information retrieval models. Our focโฆโ32Updated last year
- Code for "Merging Text Transformers from Different Initializations"โ20Updated 7 months ago