Fast and trainable tokenizer for natural languages relying on maximum entropy methods.
☆23May 2, 2017Updated 9 years ago
Alternatives and similar repositories for trainable-tokenizer
Users that are interested in trainable-tokenizer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Fast supervised sentence boundary detection using the averaged perceptron☆91Dec 8, 2018Updated 7 years ago
- C++ implementation of Constant Database (CDB++)☆23Nov 12, 2010Updated 15 years ago
- a ducttape workflow for neural machine translation☆14Mar 23, 2021Updated 5 years ago
- Runnable morphological analysis tools from the UniMorph project☆16Nov 19, 2018Updated 7 years ago
- A sparse matrix package for Python.☆30Feb 27, 2015Updated 11 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ReactiveX for data science☆14Sep 18, 2025Updated 8 months ago
- Trance parser: an implementation of transition-based neural constituent parsing☆16Aug 9, 2021Updated 4 years ago
- ☆21Dec 9, 2016Updated 9 years ago
- A collection of Go packages☆16Feb 17, 2020Updated 6 years ago
- The repository for the paper Principles for forecasting groups of time series: Locality and globality☆11Apr 30, 2021Updated 5 years ago
- Topic Model or LDA in Cython☆21Apr 9, 2011Updated 15 years ago
- Numerical and Combinatorial Optimization Library☆19Dec 14, 2013Updated 12 years ago
- Text Simplification System and Dataset☆15Jul 19, 2017Updated 8 years ago
- A C implementation of Google's Open Location Code☆10Mar 23, 2018Updated 8 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- LibCP -- A Library for Conformal Prediction☆13Feb 26, 2015Updated 11 years ago
- Sequenced Show, Attend, and Tell: Natural Language from Natural Images☆12Jun 15, 2016Updated 9 years ago
- Offline extractor of synchronous context-free grammars for machine translation.☆32Jan 14, 2016Updated 10 years ago
- Leon Bottou's SGD☆34Oct 13, 2011Updated 14 years ago
- Miscellaneous tools for clinical ML☆29Oct 21, 2017Updated 8 years ago
- LHCb trigger based on machine learning research☆17Jul 28, 2015Updated 10 years ago
- Determines the ethnicity based on your last name☆10Aug 17, 2014Updated 11 years ago
- Work in progress. Read at your own risk.☆15Jan 21, 2016Updated 10 years ago
- Functional matrix factorization via Bayesian tensor filtering☆13Oct 1, 2025Updated 7 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Provide a standard source set (and build) for various compression libraries☆13May 21, 2016Updated 10 years ago
- A locality-sensitive hashing library☆44Feb 21, 2014Updated 12 years ago
- ☆24Jun 27, 2017Updated 8 years ago
- Efficiency/Effectiveness Trade-offs in Learning to Rank☆12Sep 11, 2018Updated 7 years ago
- Experimental new Python bindings for the VowpalWabbit library☆12Oct 5, 2023Updated 2 years ago
- Implementation of safe offline bandit algorithms.☆10Oct 27, 2019Updated 6 years ago
- Code for the Adversarial Image Detectors and a Saliency Map☆12Mar 23, 2017Updated 9 years ago
- Implementation of many similarity join algorithms.☆15Mar 6, 2014Updated 12 years ago
- Polygot C implementation of compact approximate quantile estimation large data sets☆18Aug 24, 2025Updated 9 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Implementation of Bayesian Sets for fast similarity searches.☆14Oct 2, 2011Updated 14 years ago
- OCaml bindings to libuv -- Cross-platform asychronous I/O☆18Jan 12, 2015Updated 11 years ago
- finite-state toolkit, EM and Bayesian (Gibbs sampling) training for FST and context-free derivation forests☆41Oct 14, 2022Updated 3 years ago
- Evolutionary feature synthesis☆18Oct 12, 2015Updated 10 years ago
- This repository contains the scripts used during my participation on CIKM Cup 2016 (see http://cikmcup.org/ and https://competitions.coda…☆11Nov 4, 2016Updated 9 years ago
- A Rust🦀 implementation of CRAFTML, an Efficient Clustering-based Random Forest for Extreme Multi-label Learning☆15Mar 19, 2019Updated 7 years ago
- Code for paper by Bamler & Mandt, "Extreme Classification via Adversarial Softmax Approximation" (ICLR 2020)☆14Apr 8, 2020Updated 6 years ago