mzbac / qlora-inference-multi-gpuLinks
☆13Updated 2 years ago
Alternatives and similar repositories for qlora-inference-multi-gpu
Users that are interested in qlora-inference-multi-gpu are comparing it to the libraries listed below
Sorting:
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆69Updated 2 years ago
- GPT-4 Level Conversational QA Trained In a Few Hours☆65Updated last year
- ☆54Updated last year
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆35Updated last year
- Fast approximate inference on a single GPU with sparsity aware offloading☆37Updated last year
- Scripts to create your own moe models using mlx☆90Updated last year
- ☆51Updated last year
- Tune MPTs☆84Updated 2 years ago
- entropix style sampling + GUI☆27Updated 11 months ago
- 🚀 Automatically convert unstructured data into a high-quality 'textbook' format, optimized for fine-tuning Large Language Models (LLMs)☆25Updated 2 years ago
- Modified Beam Search with periodical restart☆12Updated last year
- A converter and basic tester for rwkv onnx☆42Updated last year
- Data preparation code for CrystalCoder 7B LLM☆45Updated last year
- ☆21Updated 2 years ago
- Simple Implementation of a Transformer in the new framework MLX by Apple☆18Updated 10 months ago
- Let's create synthetic textbooks together :)☆75Updated last year
- ☆26Updated last year
- Finetune any model on HF in less than 30 seconds☆55Updated last week
- Our data munging code.☆33Updated 2 weeks ago
- ☆38Updated 5 months ago
- Zeta implementation of a reusable and plug in and play feedforward from the paper "Exponentially Faster Language Modeling"☆15Updated 11 months ago
- ☆26Updated 2 years ago
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31Updated last year
- An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO☆29Updated this week
- Using multiple LLMs for ensemble Forecasting☆16Updated last year
- 🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform☆38Updated last year
- Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit☆62Updated 2 years ago
- ☆73Updated 2 years ago
- An unsupervised model merging algorithm for Transformers-based language models.☆106Updated last year
- [WIP] Transformer to embed Danbooru labelsets☆13Updated last year