Performant language agnostic tokenization for NLP.
☆10Sep 19, 2020Updated 6 years ago
Alternatives and similar repositories for FastTokenizer
Users that are interested in FastTokenizer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- c++ mosestokenizer☆18Mar 13, 2024Updated 2 years ago
- This repo includes demos for Coursera course "Neural Networks for Machine Learning".☆15Sep 23, 2017Updated 9 years ago
- The official code repository for MetricMT - a reward optimization method for NMT with learned metrics☆25Apr 24, 2021Updated 5 years ago
- Create an LSTM encoder-decoder model that will translate English sentences into French using Encoder-Decoder LSTM.☆17Jan 6, 2021Updated 5 years ago
- 🦅🔗 Building FlyteGPT on Flyte with LangChain☆30Jan 23, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- 基于 onnxruntime 推理引擎的中文 ltp 词法分析☆14Oct 4, 2022Updated 4 years ago
- Fast fuzzy regex matcher: specify max edit distance to find approximate matches. FuzzyMatcher is now included in RE/flex.☆39Apr 29, 2025Updated last year
- WeMix public repository☆11Nov 21, 2024Updated last year
- ☆13Jan 19, 2020Updated 6 years ago
- Large-scale exact string matching tool☆17Mar 7, 2025Updated last year
- Artrade : The first social network for the NFT market !☆12Mar 16, 2022Updated 4 years ago
- FederatedCatalog☆12Mar 19, 2026Updated 7 months ago
- A way to run both Chrome OS and Arch Linux simultaneously on a Samsung Chromebook☆14Aug 2, 2012Updated 14 years ago
- AdamW optimizer for bfloat16 models in pytorch 🔥.☆41Jun 16, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Starter Code for Node API 3 Afternoon Project☆10Jul 19, 2023Updated 3 years ago
- Training HuggingFace models using fastai☆11Jul 22, 2021Updated 5 years ago
- Mille Crepe Bench: layer-wise performance analysis for deep learning frameworks.☆18Oct 22, 2019Updated 7 years ago
- A fruit detection and quality analysis using Convolutional Neural Networks and Image Processing☆10Mar 5, 2019Updated 7 years ago
- This is a machine learning framework that enables developers to iterate fast over different ML architecture designs.☆16Apr 20, 2020Updated 6 years ago
- 一个非常高效的字符串匹配工具，支持正向/反向最大匹配分词和多模式字符串精确匹配☆16Jul 29, 2023Updated 3 years ago
- Term Project, Parallel Algorithms, Summer 2020, The University of Texas, Austin☆31Mar 26, 2021Updated 5 years ago
- AI生成内容检测分类器☆12May 7, 2025Updated last year
- ECBS5334 - Big Data Computing with Apache Spark - CEU.edu Class - MSc in Business Analytics☆14Jan 7, 2026Updated 9 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- C++ implementation of Ukkonen's algorithm.☆15Mar 5, 2018Updated 8 years ago
- Wav2vec2 Large XLSR 53 fine-tuned for Malayalam☆11Sep 7, 2021Updated 5 years ago
- Official code for StochasTok: Improving Fine-Grained Subword Understanding in LLMs☆14Mar 28, 2026Updated 7 months ago
- LCXL影子系统☆45Aug 16, 2024Updated 2 years ago
- ☆11Oct 2, 2020Updated 6 years ago
- Source code for 'Getting to Know Vue.js' by Brett Nelson☆15Dec 10, 2018Updated 7 years ago
- A useful tool for visualizing and analyzing where our models weaknesses are☆13Aug 15, 2019Updated 7 years ago
- Implements a proof-of-concept of a multi-level clustering algorithm designed to enable extremely fast approximate match search in a large…☆12Feb 24, 2013Updated 13 years ago
- A series of MATLAB scripts for my personal understanding and implementation of Digital Signal Processing algorithms☆15Jul 3, 2013Updated 13 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- DEPRECATED: Command-line tool and Python API for targeted syntactic evaluation of language models☆12Feb 13, 2024Updated 2 years ago
- Instructions for the Course Mastering Argo Rollouts: Progressive Delivery in Kubernetes☆13Nov 19, 2024Updated last year
- Binance liquid staking solution☆11Oct 13, 2026Updated 3 weeks ago
- The executable textbook for Zero-Employee Organizations. Sovereign Agent 1.x is a small Python reference implementation for learning how…☆17Oct 27, 2026Updated last week
- AVS package for altlayer nodes https://eigen.nethermind.io/docs/introduction☆11Apr 9, 2025Updated last year
- The Westermo test system performance data set☆12Nov 24, 2023Updated 2 years ago
- Modified version of fairseq, including new implementations for criterions using reinforcement learning methods.☆11Aug 14, 2019Updated 7 years ago