lxe / llama-tune
LLaMa Tuning with Stanford Alpaca Dataset using Deepspeed and Transformers
☆51Updated 2 years ago
Alternatives and similar repositories for llama-tune:
Users that are interested in llama-tune are comparing it to the libraries listed below
- ☆104Updated last year
- Inference script for Meta's LLaMA models using Hugging Face wrapper☆110Updated 2 years ago
- MultilingualShareGPT, the free multi-language corpus for LLM training☆73Updated last year
- The aim of this repository is to utilize LLaMA to reproduce and enhance the Stanford Alpaca☆97Updated last year
- ☆67Updated last year
- ☆124Updated last year
- MEASURING MASSIVE MULTITASK CHINESE UNDERSTANDING☆87Updated last year
- Unofficial implementation of AlpaGasus☆90Updated last year
- ☆178Updated 2 years ago
- 百川Dynamic NTK-ALiBi的代码实现：无需微调即可推理更长文本☆47Updated last year
- code for Scaling Laws of RoPE-based Extrapolation☆72Updated last year
- OPD: Chinese Open-Domain Pre-trained Dialogue Model☆75Updated last year
- An experimental implementation of the retrieval-enhanced language model☆74Updated 2 years ago
- Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks☆208Updated last year
- ☆172Updated last year
- A Multi-Turn Dialogue Corpus based on Alpaca Instructions☆168Updated last year
- MultilingualSIFT: Multilingual Supervised Instruction Fine-tuning☆89Updated last year
- [ICLR 2023] Codebase for Copy-Generator model, including an implementation of kNN-LM☆185Updated 2 months ago
- A dataset for training/evaluating Question Answering Retrieval models on ChatGPT responses with the possibility to training/evaluating on…☆140Updated last year
- CLongEval: A Chinese Benchmark for Evaluating Long-Context Large Language Models☆40Updated last year
- train llama on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism☆216Updated last year
- The complete training code of the open-source high-performance Llama model, including the full process from pre-training to RLHF.☆65Updated 2 years ago
- 用于微调LLM的中文指令数据集☆27Updated last year
- Light local website for displaying performances from different chat models.☆85Updated last year
- Code and models for BERT on STILTs☆53Updated 2 years ago
- Ongoing research training transformer language models at scale, including: BERT & GPT-2☆69Updated last year
- Official codebase for "SelFee: Iterative Self-Revising LLM Empowered by Self-Feedback Generation"☆226Updated last year
- Leveraging large language models for text-to-SQL synthesis, this project fine-tunes WizardLM/WizardCoder-15B-V1.0 with QLoRA on a custom …☆43Updated last year
- ☆96Updated last year
- Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.☆179Updated 2 years ago