lxe / llama-tuneLinks
LLaMa Tuning with Stanford Alpaca Dataset using Deepspeed and Transformers
☆51Updated 2 years ago
Alternatives and similar repositories for llama-tune
Users that are interested in llama-tune are comparing it to the libraries listed below
Sorting:
- The aim of this repository is to utilize LLaMA to reproduce and enhance the Stanford Alpaca☆98Updated 2 years ago
- ☆104Updated 2 years ago
- ☆124Updated last year
- Inference script for Meta's LLaMA models using Hugging Face wrapper☆110Updated 2 years ago
- A dataset for training/evaluating Question Answering Retrieval models on ChatGPT responses with the possibility to training/evaluating on…☆141Updated last year
- ☆96Updated 2 years ago
- Implementation of Reinforcement Learning from Human Feedback (RLHF)☆172Updated 2 years ago
- A Multi-Turn Dialogue Corpus based on Alpaca Instructions☆173Updated 2 years ago
- OPD: Chinese Open-Domain Pre-trained Dialogue Model☆75Updated 2 years ago
- [ICLR 2023] Codebase for Copy-Generator model, including an implementation of kNN-LM☆186Updated 6 months ago
- An experimental implementation of the retrieval-enhanced language model☆76Updated 2 years ago
- train llama on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism☆224Updated last year
- MultilingualShareGPT, the free multi-language corpus for LLM training☆73Updated 2 years ago
- Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks☆208Updated last year
- ☆180Updated 2 years ago
- ☆59Updated 2 years ago
- ☆68Updated 2 years ago
- 百川Dynamic NTK-ALiBi的代码实现:无需微调即可推理更长文本☆47Updated last year
- Source codes and datasets for How well do Large Language Models perform in Arithmetic tasks?☆56Updated 2 years ago
- code for Scaling Laws of RoPE-based Extrapolation☆73Updated last year
- Implementation of Toolformer: Language Models Can Teach Themselves to Use Tools☆140Updated 2 years ago
- Reverse Instructions to generate instruction tuning data with corpus examples☆214Updated last year
- Unofficial implementation of AlpaGasus☆92Updated last year
- realize the reinforcement learning training for gpt2 llama bloom and so on llm model☆26Updated last year
- An open-source conversational language model developed by the Knowledge Works Research Laboratory at Fudan University.☆64Updated last year
- Official codebase for "SelFee: Iterative Self-Revising LLM Empowered by Self-Feedback Generation"☆229Updated 2 years ago
- A self-ailgnment method for role-play. Benchmark for role-play. Resources for "Large Language Models are Superpositions of All Characters…☆203Updated last year
- make LLM easier to use☆59Updated 2 years ago
- YuLan-IR: Information Retrieval Boosted LMs☆222Updated last year
- An Experiment on Dynamic NTK Scaling RoPE☆64Updated last year