UIC-Liu-Lab / ContinualLM
An Extensible Continual Learning Framework Focused on Language Models (LMs)
☆253Updated 9 months ago
Related projects ⓘ
Alternatives and complementary repositories for ContinualLM
- Must-read Papers on Large Language Model (LLM) Continual Learning☆134Updated last year
- [EMNLP 2023] The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning☆214Updated last year
- Continual Learning of Large Language Models: A Comprehensive Survey☆255Updated last week
- A Survey on Data Selection for Language Models☆183Updated last month
- A curated list of Human Preference Datasets for LLM fine-tuning, RLHF, and eval.☆318Updated last year
- All available datasets for Instruction Tuning of Large Language Models☆237Updated 11 months ago
- ☆247Updated last year
- Codes and Data for Scaling Relationship on Learning Mathematical Reasoning with Large Language Models☆221Updated 2 months ago
- RewardBench: the first evaluation tool for reward models.☆437Updated last month
- DSIR large-scale data selection framework for language model training☆231Updated 7 months ago
- Official implementation for the paper "DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models"☆430Updated 7 months ago
- Code and data for "Lost in the Middle: How Language Models Use Long Contexts"☆318Updated 10 months ago
- A large-scale, fine-grained, diverse preference dataset (and models).☆315Updated 10 months ago
- Implementation of ICML 23 Paper: Specializing Smaller Language Models towards Multi-Step Reasoning.☆125Updated last year
- ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool Embeddings - NeurIPS 2023 (oral)☆235Updated 7 months ago
- This repository provides an original implementation of Detecting Pretraining Data from Large Language Models by *Weijia Shi, *Anirudh Aji…☆208Updated last year
- Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Ziha…☆104Updated 5 months ago
- Implementation of paper Data Engineering for Scaling Language Models to 128K Context☆440Updated 8 months ago
- Simple next-token-prediction for RLHF☆220Updated last year
- Pytorch implementation of DoReMi, a method for optimizing the data mixture weights in language modeling datasets☆306Updated 10 months ago
- [EMNLP 2023] Adapting Language Models to Compress Long Contexts☆278Updated 2 months ago
- ☆259Updated last year
- 🐋 An unofficial implementation of Self-Alignment with Instruction Backtranslation.☆133Updated 5 months ago
- Official repository of NEFTune: Noisy Embeddings Improves Instruction Finetuning☆384Updated 6 months ago
- Must-read Papers of Parameter-Efficient Tuning (Delta Tuning) Methods on Pre-trained Models.☆277Updated last year
- Data and Code for Program of Thoughts (TMLR 2023)☆243Updated 6 months ago
- contrastive decoding☆181Updated 2 years ago
- [ICML 2024] LESS: Selecting Influential Data for Targeted Instruction Tuning☆376Updated last month
- ICML'2022: Black-Box Tuning for Language-Model-as-a-Service & EMNLP'2022: BBTv2: Towards a Gradient-Free Future with Large Language Model…☆260Updated 2 years ago
- ToolBench, an evaluation suite for LLM tool manipulation capabilities.☆145Updated 8 months ago