A finetuning pipeline for instruct tuning Raven 14bn using QLORA 4bit and the Ditty finetuning library
☆27Jun 5, 2024Updated 2 years ago
Alternatives and similar repositories for rwkv-raven-qlora-4bit-instruct
Users that are interested in rwkv-raven-qlora-4bit-instruct are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A library for simplifying training with multi gpu setups in the HuggingFace / PyTorch ecosystem.☆16Jun 10, 2026Updated 3 months ago
- Fine-tuning RWKV-World model☆26Jun 6, 2023Updated 3 years ago
- rwkv finetuning☆36Apr 22, 2024Updated 2 years ago
- ☆13Jun 3, 2023Updated 3 years ago
- Script and instruction how to fine-tune large RWKV model on your data for Alpaca dataset☆31Apr 2, 2023Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Training a reward model for RLHF using RWKV.☆15Jun 5, 2023Updated 3 years ago
- ☆12Dec 21, 2024Updated last year
- ☆82May 15, 2024Updated 2 years ago
- Create multi-node K3s cluster in VirtualBox☆13Oct 1, 2022Updated 3 years ago
- 基于RWKV模型的角色扮演，实际上是个改的妈都不认识的 RWKV_Role_Playing☆17Aug 17, 2023Updated 3 years ago
- RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best …☆10Nov 3, 2023Updated 2 years ago
- RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best …☆410Jul 11, 2023Updated 3 years ago
- This project is established for real-time training of the RWKV model.☆48May 17, 2024Updated 2 years ago
- Implementation of the RWKV language model in pure WebGPU/Rust.☆360Jun 1, 2026Updated 3 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Enhancing LangChain prompts to work better with RWKV models☆32May 30, 2023Updated 3 years ago
- The Adaptive Radix Tree for Rust☆17Jan 18, 2025Updated last year
- jQuery, React and Streamlit applications written by LLMs☆16Dec 24, 2023Updated 2 years ago
- ☆12Aug 2, 2026Updated last month
- Automatic per-branch PostgreSQL databases for Rails development☆23Sep 1, 2026Updated 3 weeks ago
- Luv Sense Digital Game☆18Jul 28, 2026Updated 2 months ago
- Tools for mapping data from remote sources in Dart, similar to Elm's RemoteData: https://elmprogramming.com/remote-data.html☆14Jan 22, 2023Updated 3 years ago
- Penrose tiling generator☆20Jan 5, 2022Updated 4 years ago
- Official Chinese documentation for RWKV | RWKV官方中文文档☆15Sep 4, 2026Updated 3 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A web app to experiment with chained prompts faster.☆16Mar 15, 2023Updated 3 years ago
- ☆10Jun 7, 2026Updated 3 months ago
- List of Arabic Benchmarks for Arabic LLMs☆20Feb 24, 2026Updated 7 months ago
- RWKV v5,v6 LoRA Trainer on Cuda and Rocm Platform. RWKV is a RNN with transformer-level LLM performance. It can be directly trained like …☆13Mar 24, 2024Updated 2 years ago
- Direct Preference Optimization for RWKV, aiming for RWKV-5 and 6.☆11Mar 1, 2024Updated 2 years ago
- PureECS アニメーション検証☆13Dec 3, 2018Updated 7 years ago
- AWS SQS extended client functionality from amazon-sqs-java-extended-client-lib☆15Nov 17, 2023Updated 2 years ago
- Deep-embedded combinators for strategic rewriting.☆15Nov 24, 2021Updated 4 years ago
- Node.js implementation binding for the RWKV.cpp module☆22Aug 2, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- laravel 中国地图web Api集合☆13Apr 27, 2023Updated 3 years ago
- 有一个通用实体关系事件抽取的任务，需要使用到UIE模框架，而且需要将起部署到昇腾310服务器上，因为UIE模型底层使用的是ernie3.0，但是目前paddle官方还不支持ernie3.0模型在昇腾310上部署，所以才有了以下的操作，主要过程是，先试用paddle训练处模型…☆21Aug 1, 2022Updated 4 years ago
- Rust zeromq bindings.☆10Aug 28, 2023Updated 3 years ago
- Tune MPTs☆84Jun 17, 2023Updated 3 years ago
- This app will help you manage you applications locals easily. set you locals in groups, translate them with google translation and then e…☆13Jun 29, 2022Updated 4 years ago
- Flutter social app☆17Jan 12, 2019Updated 7 years ago
- Free ACELP vocoder☆18Sep 20, 2024Updated 2 years ago