YJiangcm / Lion
[EMNLP 2023] Lion: Adversarial Distillation of Proprietary Large Language Models
☆204Updated last year
Alternatives and similar repositories for Lion:
Users that are interested in Lion are comparing it to the libraries listed below
- Dataset and evaluation script for "Evaluating Hallucinations in Chinese Large Language Models"☆124Updated 9 months ago
- MEASURING MASSIVE MULTITASK CHINESE UNDERSTANDING☆87Updated last year
- ☆127Updated last year
- Naive Bayes-based Context Extension☆322Updated 3 months ago
- ☆137Updated 11 months ago
- InsTag: A Tool for Data Analysis in LLM Supervised Fine-tuning☆247Updated last year
- ☆160Updated last year
- ☆279Updated 11 months ago
- ☆172Updated last year
- 🐋 An unofficial implementation of Self-Alignment with Instruction Backtranslation.☆137Updated 9 months ago
- 中文图书语料MD5链接☆217Updated last year
- [NAACL'24] Self-data filtering of LLM instruction-tuning data using a novel perplexity-based difficulty score, without using any other mo…☆351Updated 6 months ago
- ☆95Updated last year
- Finetuning LLaMA with RLHF (Reinforcement Learning with Human Feedback) based on DeepSpeed Chat☆115Updated last year
- 中文 Instruction tuning datasets☆129Updated 11 months ago
- ☆166Updated last year
- code for Scaling Laws of RoPE-based Extrapolation☆72Updated last year
- 语言模型中文认知能力分析☆236Updated last year
- ☆459Updated 9 months ago
- llama2 finetuning with deepspeed and lora☆174Updated last year
- Collaborative Training of Large Language Models in an Efficient Way☆413Updated 7 months ago
- ☆81Updated last year
- deepspeed+trainer简单高效实现多卡微调大模型☆123Updated last year
- 怎么训练一个LLM分词器☆142Updated last year
- ☆97Updated last year
- [SIGIR'24] The official implementation code of MOELoRA.☆154Updated 8 months ago
- LongQLoRA: Extent Context Length of LLMs Efficiently☆164Updated last year
- ☆142Updated 9 months ago
- Must-read Papers of Parameter-Efficient Tuning (Delta Tuning) Methods on Pre-trained Models.☆281Updated last year
- Benchmarking Complex Instruction-Following with Multiple Constraints Composition (NeurIPS 2024 Datasets and Benchmarks Track)☆76Updated last month