Due to restriction of LLaMA, we try to reimplement BLOOM-LoRA (much less restricted BLOOM license here https://huggingface.co/spaces/bigscience/license) using Alpaca-LoRA and Alpaca_data_cleaned.json
☆182Jun 18, 2023Updated 2 years ago
Alternatives and similar repositories for BLOOM-LORA
Users that are interested in BLOOM-LORA are comparing it to the libraries listed below
Sorting:
- Finetune Bloom big language model with Lora method☆32Jun 9, 2023Updated 2 years ago
- We finetune Bloomz-7b1-mt using LoRA with the chatdoctor-200k dataset at here https://huggingface.co/LinhDuong/doctorwithbloomz-7b1-mt an…☆30Apr 4, 2023Updated 2 years ago
- BLOOM 模型的指令微调☆24Jun 15, 2023Updated 2 years ago
- Ai cũng có thể tự tạo chatbot bằng huấn luyện chỉ dẫn, với 12G GPU (RTX 3060) và khoảng vài chục MB dữ liệu☆114Jun 10, 2023Updated 2 years ago
- Solution for Zalo AI Challenge 2022 - E2E Question Answering☆110Dec 25, 2022Updated 3 years ago
- LORA微调BLOOMZ，参考BELLE☆25Mar 24, 2023Updated 2 years ago
- ☆28Jun 17, 2023Updated 2 years ago
- ☆18Dec 18, 2022Updated 3 years ago
- Pioneering in Vietnamese Multimodal Large Language Model☆52Jan 23, 2025Updated last year
- Example of Alpaca-LoRA with llama index.☆31Mar 30, 2023Updated 2 years ago
- A Multilingual Replicable Instruction-Following Model☆96Jun 11, 2023Updated 2 years ago
- LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale Instructions☆822May 6, 2023Updated 2 years ago
- minichatgpt - To Train ChatGPT In 5 Minutes☆169Jul 29, 2023Updated 2 years ago
- This repository contains code for extending the Stanford Alpaca synthetic instruction tuning to existing instruction-tuned models such as…☆357Jul 4, 2023Updated 2 years ago
- Instruct-tune LLaMA on consumer hardware☆18,964Jul 29, 2024Updated last year
- Alpaca dataset from Stanford, cleaned and curated☆1,582Apr 14, 2023Updated 2 years ago
- [ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters☆5,933Mar 14, 2024Updated last year
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆2,521Aug 13, 2024Updated last year
- The multilingual variant of GLM, a general language model trained with autoregressive blank infilling objective☆62Nov 19, 2022Updated 3 years ago
- Source code for Zalo AI 2021 submission☆142Dec 20, 2021Updated 4 years ago
- A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)☆4,738Jan 8, 2024Updated 2 years ago
- ☆11Aug 3, 2023Updated 2 years ago
- Let ChatGPT teach your own chatbot in hours with a single GPU!☆3,168Mar 17, 2024Updated last year
- ☆44Feb 27, 2026Updated last week
- A collection of open-source dataset to train instruction-following LLMs (ChatGPT,LLaMA,Alpaca)☆1,144Jan 4, 2024Updated 2 years ago
- C++ implementation for BLOOM☆809May 13, 2023Updated 2 years ago
- Alpaca-lora for huggingface implementation using Deepspeed and FullyShardedDataParallel☆24Apr 3, 2023Updated 2 years ago
- Aligning pretrained language models with instruction data generated by themselves.☆4,582Mar 27, 2023Updated 2 years ago
- Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Ad…☆6,083Jul 1, 2025Updated 8 months ago
- alpaca中文指令微调数据集☆397Mar 26, 2023Updated 2 years ago
- Overwrite huggingface BART and GPT with copy mechanism☆21May 3, 2023Updated 2 years ago
- ☆24Feb 5, 2024Updated 2 years ago
- 文言文信息抽取（实体识别+关系抽取）☆10Feb 24, 2023Updated 3 years ago
- KDD 2024 AQA competition 2nd place solution☆12Jul 21, 2024Updated last year
- The respository describing a novel datasets for word association explanations☆13Sep 21, 2023Updated 2 years ago
- Code for the examples presented in the talk "Training a Llama in your backyard: fine-tuning very large models on consumer hardware" given…☆15Oct 16, 2023Updated 2 years ago
- Code and documentation to train Stanford's Alpaca models, and generate the data.☆30,267Jul 17, 2024Updated last year
- Instruction Tuning with GPT-4☆4,339Jun 11, 2023Updated 2 years ago
- Searching a High Performance Feature Extractor for Text Recognition Network. TPAMI 2022☆13Nov 25, 2022Updated 3 years ago