A finetuning pipeline for instruct tuning Raven 14bn using QLORA 4bit and the Ditty finetuning library
☆27Jun 5, 2024Updated 2 years ago
Alternatives and similar repositories for rwkv-raven-qlora-4bit-instruct
Users that are interested in rwkv-raven-qlora-4bit-instruct are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A library for simplifying training with multi gpu setups in the HuggingFace / PyTorch ecosystem.☆16Jun 10, 2026Updated last month
- Fine-tuning RWKV-World model☆26Jun 6, 2023Updated 3 years ago
- ☆13Jun 3, 2023Updated 3 years ago
- Training a reward model for RLHF using RWKV.☆15Jun 5, 2023Updated 3 years ago
- ☆12Dec 21, 2024Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆81May 15, 2024Updated 2 years ago
- 基于RWKV模型的角色扮演，实际上是个改的妈都不认识的 RWKV_Role_Playing☆17Aug 17, 2023Updated 2 years ago
- RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best …☆10Nov 3, 2023Updated 2 years ago
- 实现Blip2RWKV+QFormer的多模态图文对话大模型，使用Two-Step Cognitive Psychology Prompt方法，仅3B参数的模型便能够出现类人因果思维链。对标MiniGPT-4，ImageBind等图文对话大语言模型，力求以更小的算力和资源实…☆42Jul 17, 2023Updated 3 years ago
- RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best …☆412Jul 11, 2023Updated 3 years ago
- This project is established for real-time training of the RWKV model.☆48May 17, 2024Updated 2 years ago
- Implementation of the RWKV language model in pure WebGPU/Rust.☆357Jun 1, 2026Updated last month
- Enhancing LangChain prompts to work better with RWKV models☆34May 30, 2023Updated 3 years ago
- The Adaptive Radix Tree for Rust☆17Jan 18, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- jQuery, React and Streamlit applications written by LLMs☆16Dec 24, 2023Updated 2 years ago
- Official Chinese documentation for RWKV | RWKV官方中文文档☆15Jun 10, 2026Updated last month
- 【Unity】ComputeShader + GPUInstancingで大量のドカベンOPのロゴアニメーションを動かしてみた☆11Mar 5, 2018Updated 8 years ago
- Context menu plugin for Unity3D☆13May 5, 2019Updated 7 years ago
- RWKV v5,v6 LoRA Trainer on Cuda and Rocm Platform. RWKV is a RNN with transformer-level LLM performance. It can be directly trained like …☆13Mar 24, 2024Updated 2 years ago
- Direct Preference Optimization for RWKV, aiming for RWKV-5 and 6.☆11Mar 1, 2024Updated 2 years ago
- AWS SQS extended client functionality from amazon-sqs-java-extended-client-lib☆15Nov 17, 2023Updated 2 years ago
- Alternate implementations of vector/map/set for Rust☆15Apr 27, 2023Updated 3 years ago
- Deep-embedded combinators for strategic rewriting.☆15Nov 24, 2021Updated 4 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- An experiment to write a faster/native version of SveltoECS's FasterDictionary☆17Apr 17, 2019Updated 7 years ago
- Node.js implementation binding for the RWKV.cpp module☆22Aug 2, 2023Updated 2 years ago
- laravel 中国地图web Api集合☆13Apr 27, 2023Updated 3 years ago
- 有一个通用实体关系事件抽取的任务，需要使用到UIE模框架，而且需要将起部署到昇腾310服务器上，因为UIE模型底层使用的是ernie3.0，但是目前paddle官方还不支持ernie3.0模型在昇腾310上部署，所以才有了以下的操作，主要过程是，先试用paddle训练处模型…☆21Aug 1, 2022Updated 3 years ago
- Container orchestrator and platform services☆12Aug 13, 2024Updated last year
- Tune MPTs☆84Jun 17, 2023Updated 3 years ago
- Free ACELP vocoder☆16Sep 20, 2024Updated last year
- Disk backed concurrent ART implementation, with optional generations.☆14Nov 8, 2023Updated 2 years ago
- bert-flat 简化版 添加了很多注释☆15Nov 25, 2021Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Window capture plugin for Unity☆14Nov 18, 2016Updated 9 years ago
- Pascal parser for PlasticSCM SemanticMerge tool☆15Sep 30, 2013Updated 12 years ago
- This project aims to make RWKV Accessible to everyone using a Hugging Face like interface, while keeping it close to the R and D RWKV bra…☆64May 14, 2023Updated 3 years ago
- Trying to make Tetris with Unity's ECS system☆14May 19, 2019Updated 7 years ago
- crc32 cracker for JVM☆12Jul 8, 2021Updated 5 years ago
- (Legacy) Utility and stagework scripts for MMD-style rendering workflow in Unity.☆13May 2, 2022Updated 4 years ago
- Observe the slow deterioration of my mental sanity in the github commit history☆12May 31, 2023Updated 3 years ago