AetherCortex / Llama-X
Open Academic Research on Improving LLaMA to SOTA LLM
☆1,618Updated last year
Alternatives and similar repositories for Llama-X:
Users that are interested in Llama-X are comparing it to the libraries listed below
- We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods (e.g., lora, p-tunin…☆2,728Updated last year
- [NIPS2023] RRHF & Wombat☆806Updated last year
- Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"☆1,150Updated last year
- ☆910Updated 10 months ago
- Benchmarking large language models' complex reasoning ability with chain-of-thought prompting☆2,710Updated 8 months ago
- LOMO: LOw-Memory Optimization☆984Updated 9 months ago
- A plug-and-play library for parameter-efficient-tuning (Delta Tuning)☆1,022Updated 6 months ago
- ☆459Updated 10 months ago
- ☆897Updated 8 months ago
- Instruction Tuning with GPT-4☆4,297Updated last year
- Secrets of RLHF in Large Language Models Part I: PPO☆1,353Updated last year
- Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo☆1,072Updated 8 months ago
- Ongoing research training transformer language models at scale, including: BERT & GPT-2☆2,042Updated 2 weeks ago
- Ongoing research training transformer language models at scale, including: BERT & GPT-2☆1,382Updated last year
- A simulation framework for RLHF and alternatives. Develop your RLHF method without collecting human data.☆805Updated 9 months ago
- ⚡LLM Zoo is a project that provides data, models, and evaluation benchmark for large language models.⚡☆2,943Updated last year
- 🩹Editing large language models within 10 seconds⚡☆1,321Updated last year
- Implementation of Toolformer, Language Models That Can Use Tools, by MetaAI☆2,021Updated 8 months ago
- Aligning pretrained language models with instruction data generated by themselves.☆4,337Updated 2 years ago
- ☆747Updated 10 months ago
- A collection of open-source dataset to train instruction-following LLMs (ChatGPT,LLaMA,Alpaca)☆1,114Updated last year
- The official GitHub page for the survey paper "A Survey on Evaluation of Large Language Models".☆1,512Updated last week
- Alpaca dataset from Stanford, cleaned and curated☆1,546Updated 2 years ago
- Efficient Training (including pre-training and fine-tuning) for Big Models☆582Updated 8 months ago
- An optimized deep prompt tuning strategy comparable to fine-tuning across scales and tasks☆2,031Updated last year
- Official repository for LongChat and LongEval☆517Updated 10 months ago
- Reading list of Instruction-tuning. A trend starts from Natrural-Instruction (ACL 2022), FLAN (ICLR 2022) and T0 (ICLR 2022).☆766Updated last year
- A modular RL library to fine-tune language models to human preferences☆2,297Updated last year
- YaRN: Efficient Context Window Extension of Large Language Models☆1,459Updated 11 months ago
- Let ChatGPT teach your own chatbot in hours with a single GPU!☆3,168Updated last year