bnosac / tokenizers.bpeLinks
R package for Byte Pair Encoding based on YouTokenToMe
☆16Updated 5 months ago
Alternatives and similar repositories for tokenizers.bpe
Users that are interested in tokenizers.bpe are comparing it to the libraries listed below
Sorting:
- Efficient learning of word representations☆22Updated 4 years ago
- R package for Byte Pair Encoding / Unigram modelling based on Sentencepiece☆27Updated 2 months ago
- R interface to Vowpal Wabbit☆23Updated 6 years ago
- Automate Scaffolding R Interfaces to Packages in Other Programming Languages☆28Updated 2 years ago
- An R package for out-of-core regressions☆14Updated 7 years ago
- allowing R users to work with dlib through Rcpp☆13Updated 7 years ago
- 📐Julia's implementation of word2vec in R☆24Updated 6 years ago
- torch from R!☆51Updated 5 years ago
- Combining drake workflows with R package development to train and execute a machine learning model☆14Updated 5 years ago
- Extractive Text Summariztion with lexRankr (an R package implementing the LexRank algorithm)☆21Updated 3 years ago
- Download and cache HuggingFace Hub files☆19Updated last year
- Detect the Language of Text☆52Updated 10 years ago
- R Wrapper for Google's Compact Language Detector 2☆39Updated 7 months ago
- Fast JSON Parser for R☆15Updated 7 years ago
- Hugging face tokenizers for R using extendr☆11Updated 2 years ago
- Word Factor Vectors☆32Updated 6 years ago
- Tools for Standardizing Variables for Regression in R☆22Updated 4 years ago
- Contextualised Embeddings and Language Modelling using BERT and Friends using R☆47Updated 5 years ago
- ☆46Updated 6 years ago
- This is a question-output workflow template for shiny app!☆12Updated 6 years ago
- 📝 Topic Modeling for Humans☆36Updated 5 years ago
- A small message queue for interprocess communication☆23Updated 4 years ago
- An R-package to build nesting or hierarchical structures☆13Updated 4 years ago
- 🐴🐘 Data on Members of the 116th U.S. Congress☆10Updated 6 years ago
- Visual tools to help machine learning model selection☆15Updated 4 years ago
- R package for 'Efficient Learning of Word Representations and Sentence Classification'☆45Updated 3 weeks ago
- Easy parallel programming in R -- Work in progress!☆12Updated 5 years ago
- Printable Tibbles☆15Updated 6 years ago
- Text Processing for Small or Big Data Files in R☆39Updated 2 years ago
- ☆27Updated 4 years ago