Performant language agnostic tokenization for NLP.
☆10Sep 19, 2020Updated 6 years ago
Alternatives and similar repositories for FastTokenizer
Users that are interested in FastTokenizer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- c++ mosestokenizer☆18Mar 13, 2024Updated 2 years ago
- Create an LSTM encoder-decoder model that will translate English sentences into French using Encoder-Decoder LSTM.☆17Jan 6, 2021Updated 5 years ago
- The official code repository for MetricMT - a reward optimization method for NMT with learned metrics☆25Apr 24, 2021Updated 5 years ago
- 🦅🔗 Building FlyteGPT on Flyte with LangChain☆30Jan 23, 2024Updated 2 years ago
- A way to run both Chrome OS and Arch Linux simultaneously on a Samsung Chromebook☆14Aug 2, 2012Updated 14 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 基于 onnxruntime 推理引擎的中文 ltp 词法分析☆14Oct 4, 2022Updated 4 years ago
- WeMix public repository☆11Nov 21, 2024Updated last year
- Starter Code for Node API 3 Afternoon Project☆10Jul 19, 2023Updated 3 years ago
- Artrade : The first social network for the NFT market !☆12Mar 16, 2022Updated 4 years ago
- Large-scale exact string matching tool☆17Mar 7, 2025Updated last year
- Fast fuzzy regex matcher: specify max edit distance to find approximate matches. FuzzyMatcher is now included in RE/flex.☆39Apr 29, 2025Updated last year
- Implements a proof-of-concept of a multi-level clustering algorithm designed to enable extremely fast approximate match search in a large…☆12Feb 24, 2013Updated 13 years ago
- This is a machine learning framework that enables developers to iterate fast over different ML architecture designs.☆16Apr 20, 2020Updated 6 years ago
- Source code for 'Getting to Know Vue.js' by Brett Nelson☆15Dec 10, 2018Updated 7 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A fruit detection and quality analysis using Convolutional Neural Networks and Image Processing☆10Mar 5, 2019Updated 7 years ago
- C++ implementation of Ukkonen's algorithm.☆15Mar 5, 2018Updated 8 years ago
- Mille Crepe Bench: layer-wise performance analysis for deep learning frameworks.☆18Oct 22, 2019Updated 6 years ago
- ☆17Feb 14, 2023Updated 3 years ago
- Modified version of fairseq, including new implementations for criterions using reinforcement learning methods.☆11Aug 14, 2019Updated 7 years ago
- 一个非常高效的字符串匹配工具，支持正向/反向最大匹配分词和多模式字符串精确匹配☆16Jul 29, 2023Updated 3 years ago
- PyMTL (Python library for Multi-task learning) is a Python module implementing a Multi-task learning framework built on top of scikit-lea…☆44Sep 19, 2013Updated 13 years ago
- Binance liquid staking solution☆11Updated this week
- LCXL影子系统☆45Aug 16, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- 基于Swift虚函数表的hook方案（无需dynamic，但是Swift编译优化需要修改为None）☆22Nov 17, 2021Updated 4 years ago
- Tokyo Metropolitan University Paraphrase Corpus (TMUP)☆11Jun 12, 2017Updated 9 years ago
- AVS package for altlayer nodes https://eigen.nethermind.io/docs/introduction☆11Apr 9, 2025Updated last year
- Klaytn Docs☆17Jun 4, 2024Updated 2 years ago
- 基于中文 GPT2 预训练模型的语句困惑度计算☆15Apr 20, 2023Updated 3 years ago
- The CTGViewer: display cardiotocography (CTG) records -- fetal heart rate and uterine contractions.☆11Feb 22, 2019Updated 7 years ago
- L10nization is a tool for extracting text to arb files for l10n or r13n in a Flutter application.☆21Updated this week
- A easy to use DevOps playground☆22Aug 31, 2020Updated 6 years ago
- use BFGS optimization algorithm to solve problems like curve fitting☆18Jun 28, 2021Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Fast tokenization and structural analysis of any programming language☆64Jan 14, 2025Updated last year
- 💵 Code for Less is More for Long Document Summary Evaluation by LLMs (Wu*, Iso* et al; EACL 2024)☆12Feb 22, 2024Updated 2 years ago
- AMI Meeting Parallel Corpus☆13Dec 11, 2020Updated 5 years ago
- CLI to convert Scrapbox page to Markdown☆12Jun 27, 2026Updated 3 months ago
- 基于1988出版的《现代汉语常用字表》，制作的常用汉字表（2500 + 1000）及 基本汉子表（7000）。☆21Feb 21, 2022Updated 4 years ago
- oneAPI Deep Neural Network Library (oneDNN)☆10Feb 2, 2022Updated 4 years ago
- the codes of NeuroSeg☆10Dec 17, 2017Updated 8 years ago