Patch for MPT-7B which allows using and training a LoRA
☆57May 20, 2023Updated 3 years ago
Alternatives and similar repositories for mpt-lora-patch
Users that are interested in mpt-lora-patch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Conversion script adapting vicuna dataset into alpaca format for use with oobabooga's trainer☆12Jun 21, 2023Updated 3 years ago
- Finetune Falcon, LLaMA, MPT, and RedPajama on consumer hardware using PEFT LoRA☆106Updated this week
- ☆34Apr 23, 2023Updated 3 years ago
- Instruct-tune Open LLaMA / RedPajama / StableLM models on consumer hardware using QLoRA☆80Dec 15, 2023Updated 2 years ago
- ☆15May 8, 2023Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Train Large Language Models (LLM) using LoRA☆26May 22, 2023Updated 3 years ago
- Official code for ACL 2023 (short, findings) paper "Recursion of Thought: A Divide and Conquer Approach to Multi-Context Reasoning with L…☆45Jun 13, 2023Updated 3 years ago
- ☆33Apr 23, 2023Updated 3 years ago
- A repo for finetuning MPT using LoRA. It is currently configured to work with the Alpaca dataset from Stanford but can easily be adapted …☆18Jun 12, 2023Updated 3 years ago
- Generate High Quality textual or multi-modal datasets with Agents☆18Jun 7, 2023Updated 3 years ago
- ☆14Oct 31, 2023Updated 2 years ago
- ☆17Jun 20, 2023Updated 3 years ago
- This repository contains the data and code created under the project NLP4Rare-cm-uc3m.☆10Sep 14, 2021Updated 4 years ago
- This repo helps to transform text into a better form for lora training☆12Apr 9, 2023Updated 3 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Instruct-tune LLaMA on consumer hardware with shareGPT data☆124Apr 20, 2023Updated 3 years ago
- MER is a software that identifies and highlights manipulative communication in text from human conversations and AI-generated responses. …☆15Jan 16, 2026Updated 6 months ago
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆123Jun 16, 2023Updated 3 years ago
- Pre-train BERT from scratch, with HuggingFace. Accompanies the blog post: sidsite.com/posts/bert-from-scratch☆45May 20, 2025Updated last year
- Code for the EMNLP2020 long paper "Lifelong Language Knowledge Distillation" https://arxiv.org/abs/2010.02123☆12Jul 13, 2021Updated 5 years ago
- A Two-Step Transfer Ownable contract implemented in Huff.☆16Aug 24, 2022Updated 3 years ago
- A repository for transformer critique learning and generation☆88Dec 7, 2023Updated 2 years ago
- Repository of the RANLP 2023 paper "Exploring the Landscape of Natural Language Processing Research".☆13Oct 20, 2024Updated last year
- code to train a gpt-2 model to train it on tiny stories dataset according to the TinyStories paper☆40Nov 24, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A Simple webserver for generating text with exllamav2☆14Dec 18, 2023Updated 2 years ago
- Probe how GPT-n performs on statutory reasoning☆10Sep 17, 2024Updated last year
- ☆12Oct 3, 2024Updated last year
- Samples for fine-tuning HuggingFace models with AzureML☆10Oct 14, 2021Updated 4 years ago
- Integrate an LLM copilot within your Keras model development workflow☆28Sep 23, 2023Updated 2 years ago
- Fresh and Ape-y NFT Template☆16May 10, 2024Updated 2 years ago
- A no-code application that enables companies to create intelligent digital assistants.☆13Oct 9, 2023Updated 2 years ago
- Digital organisms ecology system experiment☆16May 29, 2020Updated 6 years ago
- Interactive application to verify multiple LLMs☆14Feb 20, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Lossless normalization of uppercase characters: Go, C++ & JavaScript☆11Jul 7, 2026Updated 2 weeks ago
- ☆13Feb 26, 2023Updated 3 years ago
- Building language models to predict more than one token ahead to enable further ahead predictions.☆12May 22, 2025Updated last year
- A simple life simulation game developed in Unity, where the player can watch a group of entities move, grow, search, do pathfinding, eat,…☆13Dec 2, 2020Updated 5 years ago
- Source code repository for our EMNLP paper on cross-domain claim identification☆14Oct 24, 2018Updated 7 years ago
- Merge Transformers language models by use of gradient parameters.☆215Aug 8, 2024Updated last year
- A Continual Learning Library in PyTorch and JAX☆14Apr 18, 2023Updated 3 years ago