NovelAI / novelai-tokenizer
Sentencepiece based BPE tokenizer for English and Japanese language text.
☆27Updated last year
Alternatives and similar repositories for novelai-tokenizer:
Users that are interested in novelai-tokenizer are comparing it to the libraries listed below
- ☆20Updated 2 years ago
- ☆43Updated last year
- Hypernetworks for kohya's sd-scripts☆17Updated last year
- A notebook running TensorRT's StableDiffusion demo on Google Colaboratory☆18Updated 2 years ago
- ☆14Updated last year
- ☆28Updated 2 years ago
- ☆27Updated last year
- Speech AI training and inference tools☆36Updated last year
- Image Diffusion block merging technique applied to transformers based Language Models.☆54Updated last year
- Conversational Language model toolkit for training against human preferences.☆42Updated last year
- Anime Image Background Remover for AUTOMATIC1111☆16Updated 2 years ago
- ☆39Updated last year
- Train Llama Loras Easily☆31Updated last year
- Crawler and cleaner of data for novelai embedding's training☆20Updated last week
- Embedding Vector Visualization for Stable Diffusion web UI☆49Updated last year
- BigKnow2022: Bringing Language Models Up to Speed☆15Updated 2 years ago
- Model code for inferencing T5☆63Updated last month
- Simple extension for text-generation-webui that injects recent conversation history into the negative prompt with the goal of minimizing …☆33Updated last year
- ☆54Updated 2 years ago
- MMD2depth use MikuMikuDance model in Stable Diffusion 2.0 depth2img☆29Updated 2 years ago
- ☆36Updated last year
- Useful utilities for huggingface☆18Updated last week
- ☆41Updated last year
- Japanese LLaMa experiment☆53Updated 4 months ago
- ☆33Updated last year
- HunyuanVideo: A Systematic Framework For Large Video Generation Model☆44Updated 4 months ago
- Doohickey is a stable diffusion tool for technical artists who want to stay up-to-date with the latest developments in the field.☆39Updated 2 years ago
- ☆24Updated 3 weeks ago
- Prompt-to-prompt extention of Stable Diffusion web UI☆14Updated 2 years ago
- 📖 — Notebooks related to RWKV☆59Updated last year