RWKV-v2-RNN trained on the Pile. See https://github.com/BlinkDL/RWKV-LM for details.
☆67Sep 14, 2022Updated 4 years ago
Alternatives and similar repositories for RWKV-v2-RNN-Pile
Users that are interested in RWKV-v2-RNN-Pile are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Fork of kingoflolz/mesh-transformer-jax with memory usage optimizations and support for GPT-Neo, GPT-NeoX, BLOOM, OPT and fairseq dense L…☆22Nov 14, 2022Updated 3 years ago
- This project aims to make RWKV Accessible to everyone using a Hugging Face like interface, while keeping it close to the R and D RWKV bra…☆65May 14, 2023Updated 3 years ago
- ☆43Mar 29, 2023Updated 3 years ago
- Create soft prompts for fairseq 13B dense, GPT-J-6B and GPT-Neo-2.7B for free in a Google Colab TPU instance☆28Mar 1, 2023Updated 3 years ago
- rwkv_chatbot☆62Feb 6, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- BlinkDL's RWKV-v4 running in the browser☆48Mar 2, 2023Updated 3 years ago
- Framework agnostic python runtime for RWKV models☆147Aug 24, 2023Updated 3 years ago
- Hidden Engrams: Long Term Memory for Transformer Model Inference☆35Jun 26, 2021Updated 5 years ago
- A python library for highly configurable transformers - easing model architecture search and experimentation.☆48Nov 30, 2021Updated 4 years ago
- Anim·E, Anime Enhanced dalle mini☆40Sep 30, 2026Updated last month
- Deploy ChatGLM on Modelz☆16Mar 20, 2023Updated 3 years ago
- The CUDA version of the RWKV language model ( https://github.com/BlinkDL/RWKV-LM )☆234Dec 10, 2025Updated 10 months ago
- possibly useful materials for learning RWKV language model.☆27Jun 8, 2023Updated 3 years ago
- Doohickey is a stable diffusion tool for technical artists who want to stay up-to-date with the latest developments in the field.☆40Dec 7, 2022Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆13Jun 7, 2023Updated 3 years ago
- Frontend (and soon also midleware and backend) for a new, opensource image generation platform.☆14Nov 5, 2022Updated 3 years ago
- Guide diffusion on ImageBind embedding similarity☆29May 27, 2023Updated 3 years ago
- Let us make Psychohistory (as in Asimov) a reality, and accessible to everyone. Useful for LLM grounding and games / fiction / business /…☆40Apr 9, 2023Updated 3 years ago
- RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable)…☆14,771Updated this week
- RWKV (Receptance Weighted Key Value) is a RNN with Transformer-level performance☆40Feb 12, 2023Updated 3 years ago
- Jaehyung Kim et al's ACL 2023 paper on "infoVerse: A Universal Framework for Dataset Characterization with Multidimensional Meta-informat…☆16Jun 28, 2023Updated 3 years ago
- Code for the paper, "First Contact: Unsupervised Human-Machine Co-Adaptation via Mutual Information Maximization"☆28Jul 5, 2022Updated 4 years ago
- CPM的Transformer版☆17Nov 27, 2022Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- 视频自动混剪模型，输入主题句，混剪出围绕主题句的一段视频，核心-语义句子匹配模型☆11Mar 27, 2019Updated 7 years ago
- Run ONNX RWKV-v4 models with GPU acceleration using DirectML [Windows], or just on CPU [Windows AND Linux]; Limited to 430M model at this…☆22Mar 16, 2023Updated 3 years ago
- Prompt tuning toolkit for GPT-2 and GPT-Neo☆91Sep 27, 2021Updated 5 years ago
- PyTorch implementation for PaLM: A Hybrid Parser and Language Model.☆10Jan 7, 2020Updated 6 years ago
- AI Dungeon Catalog Archive Toolkit☆35Jul 19, 2021Updated 5 years ago
- A simple set of commands to manage three levels of modified context and link world info where necessary.☆17May 6, 2021Updated 5 years ago
- 一个简单的，由ChatGPT主导编写的api，使用简单的请求访问ChatRWKV☆15May 19, 2023Updated 3 years ago
- Neural Language Model for Go☆62Jun 30, 2023Updated 3 years ago
- Checkout the new version at the link!☆22Dec 11, 2020Updated 5 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Source code and dataset for ECML-PKDD 2020 paper "Hierarchical Interaction Networks with Rethinking Mechanism for Document-level Sentimen…☆11Jul 28, 2020Updated 6 years ago
- Tools with GUI for GPT finetune data preparation☆22Aug 24, 2021Updated 5 years ago
- Text-writing denoising diffusion (and much more)☆31May 14, 2023Updated 3 years ago
- Code for the Shortformer model, from the ACL 2021 paper by Ofir Press, Noah A. Smith and Mike Lewis.☆145Jul 26, 2021Updated 5 years ago
- Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing☆49Jan 27, 2022Updated 4 years ago
- An unsupervised model merging algorithm for Transformers-based language models.☆107Apr 29, 2024Updated 2 years ago
- Majesty Diffusion by @Dango233 and @apolinario (@multimodalart)☆25Jul 26, 2022Updated 4 years ago