reinfer / blingfire-rs
Rust wrapper for the BlingFire tokenization library
☆15Updated 4 years ago
Alternatives and similar repositories for blingfire-rs:
Users that are interested in blingfire-rs are comparing it to the libraries listed below
- Rust library for making easy parallel pipelines with Iterators.☆31Updated 5 years ago
- Calculate statistics iteratively☆38Updated last month
- An implementation of Kensler's hashed permutation algorithm☆16Updated 2 months ago
- Generic SIMD abstractions for Rust.☆47Updated 2 years ago
- Rust library for safely and explicitly parsing untrusted data☆51Updated 11 months ago
- Rust interface to word2vec.☆30Updated 5 years ago
- ☆21Updated 4 years ago
- A parser and evaluator for Rust cfg() expressions. Targets as of Rust 1.58.0 are supported.☆41Updated last week
- structured parallel execution for async Rust☆33Updated 8 months ago
- Serialization value trees☆44Updated 8 months ago
- Rust macro to build std::Command objects with shell syntax. Uses macro_rules! and works on stable.☆43Updated 5 years ago
- Big array helper for serde☆60Updated 11 months ago
- Approximate Quantiles with Configurable Worst Case Error☆15Updated 3 years ago
- ☆29Updated 11 months ago
- ☆20Updated 4 years ago
- Rust crate for displaying in different formats☆13Updated 2 years ago
- Datatest -- data-driven test framework for Rust☆53Updated last year
- A trait-based system for creating async Wakers. Because RawWakers are healthier after they've been cooked.☆21Updated 4 years ago
- Fast and compact sets of bytes or ASCII characters☆28Updated 4 years ago
- 🏹 Stack-allocated, constant-size, matrix type implemented with const generics☆18Updated 4 months ago
- Transitive derive macros for Rust☆31Updated last month
- A drop-in replacement for #[derive(Debug)] with support for members which do not implement `fmt::Debug`.☆24Updated 5 years ago
- A Rust library for runtime-checked linearish types☆32Updated last year
- Crate for data that should be pinned to the stack at the point of declaration.☆13Updated 4 years ago
- Avrow is a pure Rust implementation of the avro specification https://avro.apache.org/docs/current/spec.html with Serde support.☆29Updated 2 years ago
- SegVec data structure for rust. Similar to Vec, but allocates memory in chunks of increasing size.☆37Updated last year
- Sort Unicode strings lexicographically☆36Updated 8 months ago
- Vec-backed ID-tree☆55Updated 2 months ago
- Parsing and inspecting Rust literals (particularly useful for proc macros)☆43Updated last year
- Language tags for Rust☆38Updated 2 years ago