bjoernpl / llama_gradio_interface
Inference code for LLaMA models with Gradio Interface and rolling generation like ChatGPT
☆48Updated last year
Related projects ⓘ
Alternatives and complementary repositories for llama_gradio_interface
- Inference code for facebook LLaMA models with Wrapyfi support☆130Updated last year
- An unsupervised model merging algorithm for Transformers-based language models.☆100Updated 6 months ago
- QLoRA: Efficient Finetuning of Quantized LLMs☆77Updated 7 months ago
- Instruct-tuning LLaMA on consumer hardware☆66Updated last year
- Conversational Language model toolkit for training against human preferences.☆41Updated 7 months ago
- 4 bits quantization of SantaCoder using GPTQ☆53Updated last year
- Tune MPTs☆84Updated last year
- Inference code for LLaMA models☆45Updated last year
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆124Updated last year
- Image Diffusion block merging technique applied to transformers based Language Models.☆54Updated last year
- Train Llama Loras Easily☆29Updated last year
- Instruct-tune LLaMA on consumer hardware☆73Updated last year
- A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.☆66Updated last year
- 4 bits quantization of LLaMa using GPTQ☆130Updated last year
- 4 bits quantization of LLMs using GPTQ☆47Updated last year
- Just a simple HowTo for https://github.com/johnsmith0031/alpaca_lora_4bit☆31Updated last year
- Experimental sampler to make LLMs more creative☆30Updated last year
- The GeoV model is a large langauge model designed by Georges Harik and uses Rotary Positional Embeddings with Relative distances (RoPER).…☆122Updated last year
- Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts☆111Updated last year
- QLoRA with Enhanced Multi GPU Support☆36Updated last year
- Sakura-SOLAR-DPO: Merge, SFT, and DPO☆115Updated 10 months ago
- Finetune Falcon, LLaMA, MPT, and RedPajama on consumer hardware using PEFT LoRA☆102Updated 3 months ago
- ☆27Updated last year
- Inference code for LLaMA 2 models☆31Updated 4 months ago
- manage histories of LLM applied applications☆86Updated last year
- Exploring finetuning public checkpoints on filter 8K sequences on Pile☆115Updated last year
- ☆31Updated 10 months ago
- Merge LLM that are split in to parts☆25Updated last year