UIC-Liu-Lab / ContinualLM
An Extensible Continual Learning Framework Focused on Language Models (LMs)
☆275Updated last year
Alternatives and similar repositories for ContinualLM:
Users that are interested in ContinualLM are comparing it to the libraries listed below
- Must-read Papers on Large Language Model (LLM) Continual Learning☆141Updated last year
- All available datasets for Instruction Tuning of Large Language Models☆248Updated last year
- A Survey on Data Selection for Language Models☆225Updated 6 months ago
- ☆174Updated last year
- Official repository of NEFTune: Noisy Embeddings Improves Instruction Finetuning☆395Updated 11 months ago
- ☆255Updated last year
- Official implementation for the paper "DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models"☆481Updated 3 months ago
- [ICML 2024] LESS: Selecting Influential Data for Targeted Instruction Tuning☆435Updated 6 months ago
- [EMNLP 2023] Adapting Language Models to Compress Long Contexts☆303Updated 7 months ago
- RewardBench: the first evaluation tool for reward models.☆555Updated last month
- DSIR large-scale data selection framework for language model training☆246Updated last year
- Inference-Time Intervention: Eliciting Truthful Answers from a Language Model☆517Updated 2 months ago
- contrastive decoding☆199Updated 2 years ago
- Deita: Data-Efficient Instruction Tuning for Alignment [ICLR2024]☆547Updated 4 months ago
- Project for the paper entitled `Instruction Tuning for Large Language Models: A Survey`☆174Updated 4 months ago
- OpenICL is an open-source framework to facilitate research, development, and prototyping of in-context learning.☆555Updated last year
- 🐋 An unofficial implementation of Self-Alignment with Instruction Backtranslation.☆139Updated 10 months ago
- [EMNLP 2023] The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning☆238Updated last year
- Implementation of ICML 23 Paper: Specializing Smaller Language Models towards Multi-Step Reasoning.☆130Updated last year
- Codes and Data for Scaling Relationship on Learning Mathematical Reasoning with Large Language Models☆256Updated 7 months ago
- Generative Judge for Evaluating Alignment☆236Updated last year
- Pytorch implementation of DoReMi, a method for optimizing the data mixture weights in language modeling datasets☆321Updated last year
- ☆278Updated last year
- Code and data for "Lost in the Middle: How Language Models Use Long Contexts"☆340Updated last year
- A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).☆833Updated last week
- Reading list of Instruction-tuning. A trend starts from Natrural-Instruction (ACL 2022), FLAN (ICLR 2022) and T0 (ICLR 2022).☆766Updated last year
- ☆164Updated 10 months ago
- Self-Alignment with Principle-Following Reward Models☆160Updated last year
- A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨☆203Updated last year
- [NeurIPS 2024] Uncertainty of Thoughts: Uncertainty-Aware Planning Enhances Information Seeking in Large Language Models☆94Updated 8 months ago