RWKV-v2-RNN trained on the Pile. See https://github.com/BlinkDL/RWKV-LM for details.
☆67Sep 14, 2022Updated 3 years ago
Alternatives and similar repositories for RWKV-v2-RNN-Pile
Users that are interested in RWKV-v2-RNN-Pile are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This project aims to make RWKV Accessible to everyone using a Hugging Face like interface, while keeping it close to the R and D RWKV bra…☆65May 14, 2023Updated 2 years ago
- Fork of kingoflolz/mesh-transformer-jax with memory usage optimizations and support for GPT-Neo, GPT-NeoX, BLOOM, OPT and fairseq dense L…☆22Nov 14, 2022Updated 3 years ago
- ☆44Mar 29, 2023Updated 2 years ago
- JavaScript port of the path tracing algorithm from Peter Shirley's "Ray Tracing in One Weekend"☆11Jul 5, 2016Updated 9 years ago
- rwkv_chatbot☆62Feb 6, 2023Updated 3 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- BlinkDL's RWKV-v4 running in the browser☆48Mar 2, 2023Updated 3 years ago
- Project Ivory is a minimalism PHP forum, with a clean UI for minimalists.☆71Nov 7, 2018Updated 7 years ago
- Framework agnostic python runtime for RWKV models☆147Aug 24, 2023Updated 2 years ago
- Let us make Psychohistory (as in Asimov) a reality, and accessible to everyone. Useful for LLM grounding and games / fiction / business /…☆40Apr 9, 2023Updated 2 years ago
- ☆32Mar 30, 2023Updated 2 years ago
- GPT2 Byte Pair Encoding implementation in Golang☆25Jul 9, 2025Updated 8 months ago
- Hidden Engrams: Long Term Memory for Transformer Model Inference☆35Jun 26, 2021Updated 4 years ago
- A *tuned* minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training☆120Aug 9, 2021Updated 4 years ago
- A python library for highly configurable transformers - easing model architecture search and experimentation.☆48Nov 30, 2021Updated 4 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Creating large realisations of random fields on the sphere☆10Mar 11, 2021Updated 5 years ago
- Create soft prompts for fairseq 13B dense, GPT-J-6B and GPT-Neo-2.7B for free in a Google Colab TPU instance☆28Mar 1, 2023Updated 3 years ago
- Deploy ChatGLM on Modelz☆16Mar 20, 2023Updated 3 years ago
- Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification☆11Aug 12, 2023Updated 2 years ago
- Guide diffusion on ImageBind embedding similarity☆29May 27, 2023Updated 2 years ago
- Create RP training data from a VN, using GPT-4☆18Nov 2, 2023Updated 2 years ago
- webGL2 path tracing experiment.☆38Apr 7, 2017Updated 8 years ago
- Code for the paper, "First Contact: Unsupervised Human-Machine Co-Adaptation via Mutual Information Maximization"☆27Jul 5, 2022Updated 3 years ago
- Run ONNX RWKV-v4 models with GPU acceleration using DirectML [Windows], or just on CPU [Windows AND Linux]; Limited to 430M model at this…☆21Mar 16, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- Jaehyung Kim et al's ACL 2023 paper on "infoVerse: A Universal Framework for Dataset Characterization with Multidimensional Meta-informat…☆16Jun 28, 2023Updated 2 years ago
- ☆15Apr 18, 2022Updated 3 years ago
- 一个简单的，由ChatGPT主导编写的api，使用简单的请求访问ChatRWKV☆15May 19, 2023Updated 2 years ago
- PyTorch implementation for PaLM: A Hybrid Parser and Language Model.☆10Jan 7, 2020Updated 6 years ago
- A collection of generative and training notebooks getting mirrored to google colab.☆12May 29, 2022Updated 3 years ago
- Conversion script adapting vicuna dataset into alpaca format for use with oobabooga's trainer☆13Jun 21, 2023Updated 2 years ago
- RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable)…☆14,431Mar 5, 2026Updated 3 weeks ago
- Prompt tuning toolkit for GPT-2 and GPT-Neo☆90Sep 27, 2021Updated 4 years ago
- x-transformers-paddle 2.x version☆10May 28, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- Text-writing denoising diffusion (and much more)☆30May 14, 2023Updated 2 years ago
- stable-diffusion-webui-promptgen☆18Jul 6, 2023Updated 2 years ago
- A quick test using a Stable Diffusion server and Godot 4☆11Mar 17, 2023Updated 3 years ago
- Source code and dataset for ECML-PKDD 2020 paper "Hierarchical Interaction Networks with Rethinking Mechanism for Document-level Sentimen…☆10Jul 28, 2020Updated 5 years ago
- Tools with GUI for GPT finetune data preparation☆22Aug 24, 2021Updated 4 years ago
- A relatively basic implementation of RWKV in Rust written by someone with very little math and ML knowledge. Supports 32, 8 and 4 bit eva…☆94Sep 2, 2023Updated 2 years ago
- Efficient 3bit/4bit quantization of LLaMA models☆18May 18, 2023Updated 2 years ago