Manuel030 / alpaca-optLinks
Yet another LLM
☆10Updated 2 years ago
Alternatives and similar repositories for alpaca-opt
Users that are interested in alpaca-opt are comparing it to the libraries listed below
Sorting:
- The Next Generation Multi-Modality Superintelligence☆70Updated last year
- Experimental sampler to make LLMs more creative☆31Updated 2 years ago
- ☆40Updated 2 years ago
- GPT-2 small trained on phi-like data☆68Updated last year
- Embeddings focused small version of Llama NLP model☆107Updated 2 years ago
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆34Updated last year
- An EXA-Scale repository of Multi-Modality AI resources from papers and models, to foundational libraries!☆40Updated 2 years ago
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31Updated last year
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆63Updated 2 years ago
- ☆74Updated 2 years ago
- ☆63Updated last year
- ☆39Updated 3 years ago
- ☆35Updated 2 years ago
- Finetune Falcon, LLaMA, MPT, and RedPajama on consumer hardware using PEFT LoRA☆104Updated 8 months ago
- An all-new Language Model That Processes Ultra-Long Sequences of 100,000+ Ultra-Fast☆150Updated last year
- SparseGPT + GPTQ Compression of LLMs like LLaMa, OPT, Pythia☆42Updated 2 years ago
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆125Updated 2 years ago
- ☆33Updated 2 years ago
- Modified Beam Search with periodical restart☆12Updated last year
- Image Diffusion block merging technique applied to transformers based Language Models.☆56Updated 2 years ago
- Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first app…☆169Updated 2 years ago
- Advanced Ultra-Low Bitrate Compression Techniques for the LLaMA Family of LLMs☆110Updated 2 years ago
- 1.58-bit LLaMa model☆82Updated last year
- a tiny, exploitable chatbot that can use tools☆32Updated 2 years ago
- GoldFinch and other hybrid transformer components☆45Updated last year
- ☆17Updated 2 years ago
- GPTQLoRA: Efficient Finetuning of Quantized LLMs with GPTQ☆101Updated 2 years ago
- Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format☆27Updated 2 years ago
- entropix style sampling + GUI☆27Updated last year
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆70Updated 2 years ago