RWKV-v2-RNN trained on the Pile. See https://github.com/BlinkDL/RWKV-LM for details.
☆67Sep 14, 2022Updated 3 years ago
Alternatives and similar repositories for RWKV-v2-RNN-Pile
Users that are interested in RWKV-v2-RNN-Pile are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This project aims to make RWKV Accessible to everyone using a Hugging Face like interface, while keeping it close to the R and D RWKV bra…☆64May 14, 2023Updated 3 years ago
- Fork of kingoflolz/mesh-transformer-jax with memory usage optimizations and support for GPT-Neo, GPT-NeoX, BLOOM, OPT and fairseq dense L…☆22Nov 14, 2022Updated 3 years ago
- ☆43Mar 29, 2023Updated 3 years ago
- JAX implementations of RWKV☆18Sep 26, 2023Updated 2 years ago
- rwkv_chatbot☆62Feb 6, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Framework agnostic python runtime for RWKV models☆147Aug 24, 2023Updated 3 years ago
- Let us make Psychohistory (as in Asimov) a reality, and accessible to everyone. Useful for LLM grounding and games / fiction / business /…☆40Apr 9, 2023Updated 3 years ago
- GPT2 Byte Pair Encoding implementation in Golang☆26Jul 9, 2025Updated last year
- Hidden Engrams: Long Term Memory for Transformer Model Inference☆35Jun 26, 2021Updated 5 years ago
- A *tuned* minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training☆118Aug 9, 2021Updated 5 years ago
- Gradio UI for RWKV LLM☆27Feb 21, 2023Updated 3 years ago
- A python library for highly configurable transformers - easing model architecture search and experimentation.☆48Nov 30, 2021Updated 4 years ago
- Create soft prompts for fairseq 13B dense, GPT-J-6B and GPT-Neo-2.7B for free in a Google Colab TPU instance☆28Mar 1, 2023Updated 3 years ago
- possibly useful materials for learning RWKV language model.☆27Jun 8, 2023Updated 3 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆13Jun 7, 2023Updated 3 years ago
- Doohickey is a stable diffusion tool for technical artists who want to stay up-to-date with the latest developments in the field.☆40Dec 7, 2022Updated 3 years ago
- Guide diffusion on ImageBind embedding similarity☆29May 27, 2023Updated 3 years ago
- The CUDA version of the RWKV language model ( https://github.com/BlinkDL/RWKV-LM )☆234Dec 10, 2025Updated 8 months ago
- The Basis Programming Language☆26Jul 28, 2019Updated 7 years ago
- RWKV (Receptance Weighted Key Value) is a RNN with Transformer-level performance☆41Feb 12, 2023Updated 3 years ago
- CPM的Transformer版☆17Nov 27, 2022Updated 3 years ago
- Run ONNX RWKV-v4 models with GPU acceleration using DirectML [Windows], or just on CPU [Windows AND Linux]; Limited to 430M model at this…☆22Mar 16, 2023Updated 3 years ago
- 一个简单的，由ChatGPT主导编写的api，使用简单的请求访问ChatRWKV☆15May 19, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- PyTorch implementation for PaLM: A Hybrid Parser and Language Model.☆10Jan 7, 2020Updated 6 years ago
- Conversion script adapting vicuna dataset into alpaca format for use with oobabooga's trainer☆12Jun 21, 2023Updated 3 years ago
- RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable)…☆14,696Updated this week
- A collection of generative and training notebooks getting mirrored to google colab.☆12May 29, 2022Updated 4 years ago
- Incremental games and tools for them.☆11Jan 15, 2024Updated 2 years ago
- Prompt tuning toolkit for GPT-2 and GPT-Neo☆91Sep 27, 2021Updated 4 years ago
- Efficient 3bit/4bit quantization of LLaMA models☆18May 18, 2023Updated 3 years ago
- x-transformers-paddle 2.x version☆10May 28, 2023Updated 3 years ago
- Tools with GUI for GPT finetune data preparation☆22Aug 24, 2021Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Provide reddit RSS feeds with images inlined.☆10May 9, 2023Updated 3 years ago
- AI Dungeon Catalog Archive Toolkit☆35Jul 19, 2021Updated 5 years ago
- Text-writing denoising diffusion (and much more)☆31May 14, 2023Updated 3 years ago
- stable-diffusion-webui-promptgen☆18Jul 6, 2023Updated 3 years ago
- Turns KoboldAI into a crowdsourced distributed cluster☆34Oct 19, 2023Updated 2 years ago
- ☆17Aug 1, 2023Updated 3 years ago
- A relatively basic implementation of RWKV in Rust written by someone with very little math and ML knowledge. Supports 32, 8 and 4 bit eva…☆95Sep 2, 2023Updated 3 years ago