Supporting example for "A Rust SentencePiece implementation"
☆20Jun 7, 2020Updated 6 years ago
Alternatives and similar repositories for SentencePiece-Rust-example
Users that are interested in SentencePiece-Rust-example are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆30Sep 27, 2021Updated 5 years ago
- Instructions for how to convert a BERT Tensorflow model to work with HuggingFace's pytorch-transformers, and spaCy. This walk-through use…☆27Mar 24, 2023Updated 3 years ago
- ☆13Mar 27, 2020Updated 6 years ago
- CC-CEDICT-MeCab is a MeCab dictionary for Chinese (Mandarin) text segmentation☆13Apr 9, 2020Updated 6 years ago
- ☆12Mar 24, 2021Updated 5 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Data for SubTask A☆17Dec 13, 2021Updated 4 years ago
- RcppMeCab: Rcpp Interface of CJK Morpheme Analyzer MeCab☆27Jul 13, 2026Updated 3 months ago
- XLNet for generating language.☆163Jan 30, 2021Updated 5 years ago
- Rust-tokenizer offers high-performance tokenizers for modern language models, including WordPiece, Byte-Pair Encoding (BPE) and Unigram (…☆345Jan 22, 2026Updated 9 months ago
- Cascaded Text Generation with Markov Transformers☆130Mar 20, 2023Updated 3 years ago
- Transfer Learning via Unsupervised Task Discovery for Visual Question Answering☆31Apr 9, 2019Updated 7 years ago
- This repo parallelizes mAP_evaluation using python's multiprocessing module.☆18Apr 14, 2022Updated 4 years ago
- ☆19Feb 11, 2020Updated 6 years ago
- Yada is a yet another double-array trie library aiming for fast search and compact data representation.☆50Jun 7, 2026Updated 4 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆12Sep 2, 2021Updated 5 years ago
- Conditional Random Fields implemented in pure Rust☆13Mar 17, 2025Updated last year
- Spectral Word Embedding Learning for Language (SWELL) toolkit☆29Jul 24, 2014Updated 12 years ago
- sequence tagging for NER for ULMFiT☆20Nov 4, 2020Updated 5 years ago
- BLEU Score in Rust☆13Oct 1, 2026Updated 3 weeks ago
- Unofficial PyTorch implementation of "Filter Response Normalization Layer: Eliminating Batch Dependence in the Training of Deep Neural Ne…☆22Dec 19, 2019Updated 6 years ago
- Tool for Evaluating Adversarial Perturbations on Text☆61Feb 27, 2022Updated 4 years ago
- Code repo for "Transformer on a Diet" paper☆31Jun 22, 2020Updated 6 years ago
- 📃 Set the correct (tab) titles for your arXiv papers containing tabs.☆46Dec 10, 2025Updated 10 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Code for Retrofitting Large Language Models with Dynamic Tokenization.☆14Jul 22, 2025Updated last year
- 🌎 WebExtension version of Shut Up, supporting Chrome, Firefox, Edge, and Opera.☆15Sep 26, 2026Updated last month
- This project aims to develop a parser for mediawiki markdown on the basis of Parsing Expression Grammars.☆14Aug 23, 2021Updated 5 years ago
- This repository contains the code for "BERTRAM: Improved Word Embeddings Have Big Impact on Contextualized Representations".☆64Aug 13, 2020Updated 6 years ago
- ☆24Oct 20, 2018Updated 8 years ago
- ☆14Oct 1, 2020Updated 6 years ago
- Write-ahead-logging implementation for Rust☆16Oct 24, 2021Updated 5 years ago
- FaVIQ: Fact Verification from Information-seeking Questions☆43Nov 23, 2022Updated 3 years ago
- Tensorflow Example☆12Jun 28, 2019Updated 7 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆54Updated this week
- ☆12Jan 23, 2026Updated 9 months ago
- Just a pastebin and url shortener. Multi arch with only ~4MB image size.☆11Feb 27, 2026Updated 8 months ago
- A repo of my talks☆11Nov 28, 2023Updated 2 years ago
- ☆11Sep 13, 2022Updated 4 years ago
- A lidera japanese tokenizer wrapper for javascript and typescript☆16Dec 29, 2021Updated 4 years ago
- Simplified installation of WireGuard server for Ubuntu☆40Sep 25, 2020Updated 6 years ago