Alternatives and similar repositories for tokenizers.bpe:

Users that are interested in tokenizers.bpe are comparing it to the libraries listed below

• mlampros / fastTextR
  Efficient learning of word representations
  ☆22Updated 4 years ago
• jaytimm / corpuslingr
  A library of functions enabling complex corpus search in context (KWIC), search aggregation, bag-of-words building & keyphrase extraction…
  ☆20Updated 6 years ago
• bnosac / dlib
  allowing R users to work with dlib through Rcpp
  ☆13Updated 6 years ago
• mlverse / hfhub
  Download and cache HuggingFace Hub files
  ☆16Updated 5 months ago
• terrytangyuan / scaffolder
  Automate Scaffolding R Interfaces to Packages in Other Programming Languages
  ☆27Updated last year
• rvw-org / rvw
  R interface to Vowpal Wabbit
  ☆22Updated 5 years ago
• mdneuzerling / DrakeModelling
  Combining drake workflows with R package development to train and execute a machine learning model
  ☆14Updated 4 years ago
• dfalbel / torch
  torch from R!
  ☆51Updated 4 years ago
• DavisVaughan / so-you-want-to-use-rcpp
  ☆46Updated 6 years ago
• mlampros / fastText
  R package for 'Efficient Learning of Word Representations and Sentence Classification'
  ☆42Updated last year
• bnosac / sentencepiece
  R package for Byte Pair Encoding / Unigram modelling based on Sentencepiece
  ☆25Updated 2 years ago
• news-r / word2vec.r
  📐Julia's implementation of word2vec in R
  ☆24Updated 5 years ago
• macmillancontentscience / tidybert
  Tidy BERT-like Models
  ☆21Updated last year
• mlverse / hftokenizers
  Hugging face tokenizers for R using extendr
  ☆11Updated last year
• mlverse / torchbook_materials
  ☆28Updated 3 years ago
• mkearney / wactor
  Word Factor Vectors
  ☆33Updated 5 years ago
• wahani / dat
  Tools for Data Manipulation in R
  ☆16Updated 4 years ago
• jienagu / Shiny_Template
  This is a question-output workflow template for shiny app!
  ☆12Updated 5 years ago
• yonicd / slackreprex
  reprex + slack
  ☆31Updated 2 years ago
• mayer79 / flashlight
  Machine learning explanations
  ☆22Updated 7 months ago
• CDEager / standardize
  Tools for Standardizing Variables for Regression in R
  ☆23Updated 4 years ago
• rstudio-education / shiny-wsds18
  Materials for the "Apps and Dashboards with Shiny " workshop at WSDS 2018
  ☆19Updated 5 years ago
• ianmoran11 / locatr
  An easier way to tidying pivoted tables.
  ☆29Updated 4 years ago
• wlandau / txtq
  A small message queue for interprocess communication
  ☆23Updated 3 years ago
• mkearney / printbl
  Printable Tibbles
  ☆15Updated 6 years ago
• emitanaka / nestr
  An R-package to build nesting or hierarchical structures
  ☆13Updated 3 years ago
• quanteda / quanteda.classifiers
  quanteda textmodel extensions for classifying documents
  ☆21Updated last year
• NicChr / cheapr
  Cheap R functions to save time and memory
  ☆20Updated this week
• jlisic / SamplingBigData
  Sampling Methods for Big Data
  ☆10Updated 6 years ago
• mlampros / textTinyR
  Text Processing for Small or Big Data Files in R
  ☆38Updated last year