eliben / go-sentencepieceLinks
Go implementation of the SentencePiece tokenizer
☆31Updated 10 months ago
Alternatives and similar repositories for go-sentencepiece
Users that are interested in go-sentencepiece are comparing it to the libraries listed below
Sorting:
- Go library that implements fs.FS for Postgres using Large Objects.☆62Updated last year
- An offheap memory allocator for manual memory management in Golang☆26Updated 2 months ago
- XML Tokenizer is a low-memory high performance non-namespace parser library for parsing simple XML 1.0.☆42Updated 2 months ago
- Golang "native" implementation of word2vec algorithm (word2vec++ port)☆26Updated 7 months ago
- Ungrammar implementation and API in Go☆46Updated last year
- strftime/strptime for Go☆18Updated 2 years ago
- MinLZ is a LZ77 compressor, focused on realtime data compression☆102Updated 2 weeks ago
- VarInt: fast & memory efficient arbitrary bit width integers in Go.☆36Updated 2 years ago
- Scheduler of events for near real-time systems☆28Updated last month
- 🏇🏻 generalist, fast and tiny binary parser and compiler generator, powered by Go 1.18+ Generics☆58Updated 2 years ago
- Wrapper for simple golang preprocessors☆26Updated 3 months ago
- Ordered codes for database keys☆41Updated last year
- A fast (5x) string keyed read-only map for Go - particularly good for keys using a small set of nearby runes.☆67Updated 11 months ago
- Write Python in Go - The most intuitive Python wrapper for Golang☆39Updated 8 months ago
- Go module for fetching embeddings from embeddings providers☆53Updated last week
- Browser detection in Go (golang)☆89Updated last year
- 📐 The fastest and smallest Go math library for constrained environments, like microcontrollers or WebAssembly.☆78Updated last year
- A fast file-based priority queue☆58Updated last year
- Fast, thread-safe arena allocators☆23Updated 2 years ago
- Go UUIDv7 implementation☆24Updated 2 months ago
- A set of tools for building parsers using the Go programming language.☆45Updated 2 years ago
- A high-level interface for interacting with a Git subprocess in Go☆25Updated 8 months ago
- Basic Configuration Language☆27Updated this week
- Basic Markdown parser and HTML generator☆111Updated 7 months ago
- Dataframe library for Go.☆16Updated 2 years ago
- Sorted Data Structure Server - Treds is a Data Structure Server which returns data in sorted order and is the fastest prefix search serve…☆64Updated last month
- Pure Go SQL parser☆161Updated last month
- Faster utf8.Valid using multi-byte processing without SIMD.☆83Updated last year
- ☆48Updated 6 months ago
- Mutable strings in Golang via overlays☆14Updated 2 years ago