LLaMa Tuning with Stanford Alpaca Dataset using Deepspeed and Transformers
☆50Mar 15, 2023Updated 3 years ago
Alternatives and similar repositories for llama-tune
Users that are interested in llama-tune are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Train llama with lora on one 4090 and merge weight of lora to work as stanford alpaca.☆53Jun 16, 2023Updated 3 years ago
- Train large COMET (T5-3B/GPT2-XL) with small memory (on 11GB memory GPUs like 1080/2080) using DeepSpeed.☆14Jan 23, 2022Updated 4 years ago
- ☆43Dec 15, 2023Updated 2 years ago
- Reproduced LLaVA-NeXT with training code and scripts.☆11May 14, 2026Updated 5 months ago
- ☆10Jun 1, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆10May 5, 2023Updated 3 years ago
- train llama on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism☆224Nov 21, 2023Updated 2 years ago
- A collection of prompts for Llama☆101Mar 23, 2023Updated 3 years ago
- From Symbolic Logic Reasoning to Soft Reasoning: A Neural-Symbolic Paradigm☆12Jul 18, 2022Updated 4 years ago
- 本项目采用BERT等预训练模型实现多项选择型阅读理解任务（Multiple Choice MRC）☆16Jun 20, 2021Updated 5 years ago
- KuaiSearch PERKS☆12Nov 16, 2021Updated 4 years ago
- Fast and Effective Biomedical Entity Linking Using a Dual Encoder☆18Apr 21, 2022Updated 4 years ago
- Alpaca-lora for huggingface implementation using Deepspeed and FullyShardedDataParallel☆24Apr 3, 2023Updated 3 years ago
- self complement of baike knowledge base info-box extraction by online analysis.基于互动百科,百度百科,搜狗百科的词条infobox结构化信息抽取,百科知识的融合☆36Mar 30, 2018Updated 8 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Finetuning LLaMA with RLHF (Reinforcement Learning with Human Feedback) based on DeepSpeed Chat☆117Jun 5, 2023Updated 3 years ago
- The aim of this repository is to utilize LLaMA to reproduce and enhance the Stanford Alpaca☆98Apr 5, 2023Updated 3 years ago
- A full pipeline to finetune ChatGLM LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Huma…☆138Apr 28, 2023Updated 3 years ago
- Train 🤗transformers with DeepSpeed: ZeRO-2, ZeRO-3☆23May 20, 2021Updated 5 years ago
- User simulation for dialog systems using Inverse Reinforcement Learning☆12Feb 5, 2017Updated 9 years ago
- realize the reinforcement learning training for gpt2 llama bloom and so on llm model☆27Sep 19, 2023Updated 3 years ago
- [Findings of ACL 2022] Meta-Path Guided Contrastive Learning for Logical Reasoning of Text☆28Apr 8, 2026Updated 6 months ago
- Your AI assistant in the terminal.☆23Nov 22, 2024Updated last year
- AdaLoGN: Adaptive Logic Graph Network for Reasoning-Based Machine Reading Comprehension (ACL 2022)☆27May 20, 2022Updated 4 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Code for paper "ProgGen: Generating Named Entity Recognition Datasets Step-by-step with Self-Reflexive Large Language Models"☆17Mar 29, 2024Updated 2 years ago
- Data preparation code for CrystalCoder 7B LLM☆46May 10, 2024Updated 2 years ago
- LLaMA implementation for HuggingFace Transformers☆38Mar 17, 2023Updated 3 years ago
- chatglm多gpu用deepspeed和☆408Jul 8, 2024Updated 2 years ago
- Example of Alpaca-LoRA with llama index.☆31Mar 30, 2023Updated 3 years ago
- [EMNLP 2020] PyTorch code of PRover: Proof Generation for Interpretable Reasoning over Rules☆20Jul 6, 2023Updated 3 years ago
- A Keras implementation of the AAAI21 paper "a lightweight neural model for biomedical entity linking"☆53Jul 24, 2022Updated 4 years ago
- Code for Incorporating Relevance Feedback for Information-Seeking Retrieval using Few-Shot Document Re-Ranking, EMNLP 2022, https://aclan…☆14Mar 30, 2026Updated 7 months ago
- Linux memfd_create wrapper for Python☆11Dec 15, 2017Updated 8 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Author implementation of the paper "Don’t paraphrase, detect! Rapid and Effective Data Collection for Semantic Parsing"☆20Oct 5, 2020Updated 6 years ago
- ☆11Jun 27, 2021Updated 5 years ago
- NumGLUE: A Suite of Fundamental yet Challenging Mathematical Reasoning Tasks☆20May 10, 2022Updated 4 years ago
- ChatGLM-Peft-Tuning☆13Mar 19, 2023Updated 3 years ago
- ☆453Oct 15, 2023Updated 3 years ago
- ☆12Aug 7, 2018Updated 8 years ago
- Papers and Related work to help learn ICL conveniently for everyone who interests.☆14Feb 28, 2024Updated 2 years ago