TianyiPeng / Colab_for_Alpaca_Lora
Here is a Google Colab Notebook for fine-tuning Alpaca Lora (within 3 hours with a 40GB A100 GPU)
☆38Updated last year
Alternatives and similar repositories for Colab_for_Alpaca_Lora:
Users that are interested in Colab_for_Alpaca_Lora are comparing it to the libraries listed below
- The Next Generation Multi-Modality Superintelligence☆71Updated 6 months ago
- manage histories of LLM applied applications☆88Updated last year
- Finetune Falcon, LLaMA, MPT, and RedPajama on consumer hardware using PEFT LoRA☆102Updated 7 months ago
- ☆37Updated last year
- QLoRA: Efficient Finetuning of Quantized LLMs☆77Updated 11 months ago
- Alpaca-lora for huggingface implementation using Deepspeed and FullyShardedDataParallel☆24Updated last year
- ☆84Updated last year
- Automated testing and benchmarking for code generation agents.☆18Updated last year
- Camel-Coder: Collaborative task completion with multiple agents. Role-based prompts, intervention mechanism, and thoughtful suggestions☆33Updated last year
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated last year
- Track the progress of LLM context utilisation☆53Updated 8 months ago
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆69Updated last year
- Mixing Language Models with Self-Verification and Meta-Verification☆102Updated 3 months ago
- ☆73Updated last year
- Spherical Merge Pytorch/HF format Language Models with minimal feature loss.☆117Updated last year
- Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…☆147Updated last year
- Official code for ACL 2023 (short, findings) paper "Recursion of Thought: A Divide and Conquer Approach to Multi-Context Reasoning with L…☆43Updated last year
- Finetune any model on HF in less than 30 seconds☆58Updated last month
- Reinforcement Learning with Heuristic Imperatives - Finetuning LLMs for Post-Conventional Moral Intuition☆64Updated last year
- ☆33Updated last year
- ☆51Updated 7 months ago
- Patch for MPT-7B which allows using and training a LoRA☆58Updated last year
- ☆74Updated last year
- Advanced Reasoning Benchmark Dataset for LLMs☆45Updated last year
- Local LLM ReAct Agent with Guidance☆157Updated last year
- entropix style sampling + GUI☆25Updated 4 months ago
- Official repo of Respond-and-Respond: data, code, and evaluation☆104Updated 7 months ago
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆82Updated last year
- My implementation of "Algorithm of Thoughts: Enhancing Exploration of Ideas in Large Language Models"☆98Updated last year
- Instruct-tuning LLaMA on consumer hardware☆66Updated 2 years ago