fredi-python / Fine-tune-RedPajama-Chat-3B
Code for finetuning RedPajama-Chat-3B using LoRA
☆13Updated last year
Related projects: ⓘ
- GPT-2 small trained on phi-like data☆65Updated 7 months ago
- ☆37Updated 9 months ago
- Deploy your GGML models to HuggingFace Spaces with Docker and gradio☆34Updated last year
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31Updated 3 months ago
- Unofficial python bindings for the rust llm library. 🐍❤️🦀☆72Updated last year
- A guidance compatibility layer for llama-cpp-python☆35Updated last year
- ☆71Updated last year
- The code we currently use to fine-tune models.☆107Updated 4 months ago
- ☆64Updated 3 months ago
- ☆28Updated this week
- ☆26Updated last year
- Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub☆154Updated 11 months ago
- Scripts to create your own moe models using mlx☆86Updated 6 months ago
- ☆32Updated 7 months ago
- Code for the paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot" with LLaMA implementation.☆68Updated last year
- GRDN.AI app for garden optimization☆68Updated 7 months ago
- Just a simple HowTo for https://github.com/johnsmith0031/alpaca_lora_4bit☆30Updated last year
- Low-Rank adapter extraction for fine-tuned transformers model☆154Updated 4 months ago
- Fast approximate inference on a single GPU with sparsity aware offloading☆39Updated 8 months ago
- ☆101Updated 6 months ago
- ☆31Updated 8 months ago
- GPT-4 Level Conversational QA Trained In a Few Hours☆53Updated last month
- Falcon40B and 7B (Instruct) with streaming, top-k, and beam search☆39Updated last year
- 5X faster 60% less memory QLoRA finetuning☆21Updated 3 months ago
- Python bindings for llama.cpp☆62Updated 6 months ago
- Experimental sampler to make LLMs more creative☆29Updated last year
- QLoRA with Enhanced Multi GPU Support☆36Updated last year
- ☆14Updated 3 months ago
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆123Updated last year
- Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts☆109Updated last year