rhulha / lora
Train Large Language Models (LLM) using LoRA
☆21Updated last year
Related projects: ⓘ
- GPT-2 small trained on phi-like data☆65Updated 7 months ago
- An unsupervised model merging algorithm for Transformers-based language models.☆96Updated 4 months ago
- Model REVOLVER, a human in the loop model mixing system.☆33Updated last year
- Simple and fast server for GPTQ-quantized LLaMA inference☆24Updated last year
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆123Updated last year
- ☆26Updated last year
- ☆71Updated last year
- Patch for MPT-7B which allows using and training a LoRA☆58Updated last year
- Low-Rank adapter extraction for fine-tuned transformers model☆154Updated 4 months ago
- Let's create synthetic textbooks together :)☆70Updated 7 months ago
- Harnessing the Memory Power of the Camelids☆145Updated 11 months ago
- QLoRA: Efficient Finetuning of Quantized LLMs☆74Updated 5 months ago
- Experimental sampler to make LLMs more creative☆29Updated last year
- Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…☆40Updated 5 months ago
- All the world is a play, we are but actors in it.☆46Updated 2 months ago
- Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…☆139Updated 11 months ago
- ☆18Updated this week
- Experimental LLM Inference UX to aid in creative writing☆81Updated 2 months ago
- Just a simple HowTo for https://github.com/johnsmith0031/alpaca_lora_4bit☆30Updated last year
- 5X faster 60% less memory QLoRA finetuning☆21Updated 3 months ago
- An Extension for oobabooga/text-generation-webui☆35Updated last year
- Official code for ACL 2023 (short, findings) paper "Recursion of Thought: A Divide and Conquer Approach to Multi-Context Reasoning with L…☆41Updated last year
- ☆28Updated this week
- Easily view and modify JSON datasets for large language models☆55Updated this week
- The one who calls upon functions - Function-Calling Language Model☆36Updated 11 months ago
- Preprint: Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning☆28Updated 7 months ago
- Merge Transformers language models by use of gradient parameters.☆193Updated last month
- Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts☆109Updated last year
- RAG implementation for Ooba characters. dynamically spins up new qdrant vector DB and manages retrieval and commits for conversations ba…☆45Updated 11 months ago
- ☆101Updated 6 months ago