RWKV-v2-RNN trained on the Pile. See https://github.com/BlinkDL/RWKV-LM for details.
☆67Sep 14, 2022Updated 4 years ago
Alternatives and similar repositories for RWKV-v2-RNN-Pile
Users that are interested in RWKV-v2-RNN-Pile are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This project aims to make RWKV Accessible to everyone using a Hugging Face like interface, while keeping it close to the R and D RWKV bra…☆64May 14, 2023Updated 3 years ago
- Fork of kingoflolz/mesh-transformer-jax with memory usage optimizations and support for GPT-Neo, GPT-NeoX, BLOOM, OPT and fairseq dense L…☆22Nov 14, 2022Updated 3 years ago
- JavaScript port of the path tracing algorithm from Peter Shirley's "Ray Tracing in One Weekend"☆11Jul 5, 2016Updated 10 years ago
- JAX implementations of RWKV☆18Sep 26, 2023Updated 2 years ago
- rwkv_chatbot☆62Feb 6, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- BlinkDL's RWKV-v4 running in the browser☆48Mar 2, 2023Updated 3 years ago
- Framework agnostic python runtime for RWKV models☆147Aug 24, 2023Updated 3 years ago
- ☆32Mar 30, 2023Updated 3 years ago
- Let us make Psychohistory (as in Asimov) a reality, and accessible to everyone. Useful for LLM grounding and games / fiction / business /…☆40Apr 9, 2023Updated 3 years ago
- GPT2 Byte Pair Encoding implementation in Golang☆26Jul 9, 2025Updated last year
- Hidden Engrams: Long Term Memory for Transformer Model Inference☆35Jun 26, 2021Updated 5 years ago
- A *tuned* minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training☆118Aug 9, 2021Updated 5 years ago
- Gradio UI for RWKV LLM☆27Feb 21, 2023Updated 3 years ago
- A python library for highly configurable transformers - easing model architecture search and experimentation.☆48Nov 30, 2021Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Creating large realisations of random fields on the sphere☆10Sep 17, 2026Updated last week
- Create soft prompts for fairseq 13B dense, GPT-J-6B and GPT-Neo-2.7B for free in a Google Colab TPU instance☆28Mar 1, 2023Updated 3 years ago
- Anim·E, Anime Enhanced dalle mini☆40Sep 11, 2022Updated 4 years ago
- possibly useful materials for learning RWKV language model.☆27Jun 8, 2023Updated 3 years ago
- ☆13Jun 7, 2023Updated 3 years ago
- Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification☆11Aug 12, 2023Updated 3 years ago
- Doohickey is a stable diffusion tool for technical artists who want to stay up-to-date with the latest developments in the field.☆40Dec 7, 2022Updated 3 years ago
- Guide diffusion on ImageBind embedding similarity☆29May 27, 2023Updated 3 years ago
- The Basis Programming Language☆26Jul 28, 2019Updated 7 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Code for the paper, "First Contact: Unsupervised Human-Machine Co-Adaptation via Mutual Information Maximization"☆27Jul 5, 2022Updated 4 years ago
- RWKV (Receptance Weighted Key Value) is a RNN with Transformer-level performance☆40Feb 12, 2023Updated 3 years ago
- CPM的Transformer版☆17Nov 27, 2022Updated 3 years ago
- Run ONNX RWKV-v4 models with GPU acceleration using DirectML [Windows], or just on CPU [Windows AND Linux]; Limited to 430M model at this…☆22Mar 16, 2023Updated 3 years ago
- Jaehyung Kim et al's ACL 2023 paper on "infoVerse: A Universal Framework for Dataset Characterization with Multidimensional Meta-informat…☆16Jun 28, 2023Updated 3 years ago
- 一个简单的，由ChatGPT主导编写的api，使用简单的请求访问ChatRWKV☆15May 19, 2023Updated 3 years ago
- ☆15Apr 18, 2022Updated 4 years ago
- PyTorch implementation for PaLM: A Hybrid Parser and Language Model.☆10Jan 7, 2020Updated 6 years ago
- Conversion script adapting vicuna dataset into alpaca format for use with oobabooga's trainer☆12Jun 21, 2023Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable)…☆14,716Updated this week
- Prompt tuning toolkit for GPT-2 and GPT-Neo☆91Sep 27, 2021Updated 4 years ago
- Efficient 3bit/4bit quantization of LLaMA models☆18May 18, 2023Updated 3 years ago
- x-transformers-paddle 2.x version☆10May 28, 2023Updated 3 years ago
- Utilities for creating generative art☆26Apr 28, 2019Updated 7 years ago
- Turns KoboldAI into a crowdsourced distributed cluster☆34Oct 19, 2023Updated 2 years ago
- A relatively basic implementation of RWKV in Rust written by someone with very little math and ML knowledge. Supports 32, 8 and 4 bit eva…☆95Sep 2, 2023Updated 3 years ago