kallewoof / lora-merge
A script for merging a LLM model and a LoRA
☆12Updated last year
Alternatives and similar repositories for lora-merge:
Users that are interested in lora-merge are comparing it to the libraries listed below
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated last year
- ☆27Updated last year
- ☆31Updated 8 months ago
- ☆53Updated 9 months ago
- Nexusflow function call, tool use, and agent benchmarks.☆19Updated 2 months ago
- ☆20Updated 9 months ago
- The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models☆21Updated 3 months ago
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆63Updated last year
- Experimental sampler to make LLMs more creative☆30Updated last year
- ☆41Updated 9 months ago
- ☆48Updated 4 months ago
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31Updated 9 months ago
- ☆13Updated last year
- Finetune any model on HF in less than 30 seconds☆58Updated last month
- entropix style sampling + GUI☆25Updated 4 months ago
- Modified Beam Search with periodical restart☆12Updated 5 months ago
- Using multiple LLMs for ensemble Forecasting☆16Updated last year
- Lightweight continuous batching OpenAI compatibility using HuggingFace Transformers include T5 and Whisper.☆21Updated 2 weeks ago
- ☆20Updated last year
- ☆18Updated last year
- Uses a Gradio interface to stream coding related responses from local and cloud based large language models. Pulls context from GitHub Re…☆19Updated this week
- A repository to store helpful information and emerging insights in regard to LLMs☆20Updated last year
- Proteus is an experimental platform that combines the power of Large Language Models with the Genesis physics engine☆21Updated 2 months ago
- Port of Facebook's LLaMA model in C/C++☆20Updated last year
- QuIP quantization☆51Updated 11 months ago
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆69Updated last year
- Simple LLM inference server☆20Updated 8 months ago