fredi-python / Fine-tune-RedPajama-Chat-3B
Code for finetuning RedPajama-Chat-3B using LoRA
☆13Updated last year
Alternatives and similar repositories for Fine-tune-RedPajama-Chat-3B:
Users that are interested in Fine-tune-RedPajama-Chat-3B are comparing it to the libraries listed below
- ☆38Updated last year
- ☆73Updated last year
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆31Updated 10 months ago
- The code we currently use to fine-tune models.☆114Updated 10 months ago
- QLoRA with Enhanced Multi GPU Support☆36Updated last year
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆123Updated last year
- ☆27Updated last year
- GPT-2 small trained on phi-like data☆65Updated last year
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆69Updated last year
- Using multiple LLMs for ensemble Forecasting☆16Updated last year
- Image Diffusion block merging technique applied to transformers based Language Models.☆54Updated last year
- ☆20Updated last year
- ☆31Updated last year
- Experiments w/ ChatGPT, LangChain, local LLMs☆24Updated last year
- Experimental sampler to make LLMs more creative☆30Updated last year
- ☆22Updated last year
- OpenMindedChatbot is a Proof Of Concept that leverages the power of Open source Large Language Models (LLM) with Function Calling capabil…☆29Updated last year
- Command-line script for inferencing from models such as MPT-7B-Chat☆101Updated last year
- an implementation of Self-Extend, to expand the context window via grouped attention☆118Updated last year
- Using modal.com to process FineWeb-edu data☆20Updated 3 weeks ago
- Model REVOLVER, a human in the loop model mixing system.☆33Updated last year
- Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts☆111Updated last year
- entropix style sampling + GUI☆25Updated 4 months ago
- ☆66Updated 10 months ago
- Text generation in Python, as easy as possible☆56Updated last week
- ☆33Updated last year
- Unofficial python bindings for the rust llm library. 🐍❤️🦀☆75Updated last year
- 🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform☆37Updated last year
- Instruct-tuning LLaMA on consumer hardware☆66Updated 2 years ago
- Falcon40B and 7B (Instruct) with streaming, top-k, and beam search☆40Updated last year