eliben / go-sentencepieceLinks
Go implementation of the SentencePiece tokenizer
☆37Updated last year
Alternatives and similar repositories for go-sentencepiece
Users that are interested in go-sentencepiece are comparing it to the libraries listed below
Sorting:
- Golang "native" implementation of word2vec algorithm (word2vec++ port)☆29Updated last month
- Go library that implements fs.FS for Postgres using Large Objects.☆64Updated 2 months ago
- XML Tokenizer is a low-memory high performance non-namespace parser library for parsing simple XML 1.0.☆43Updated last month
- Ungrammar implementation and API in Go☆46Updated last year
- Write Python in Go - The most intuitive Python wrapper for Golang☆40Updated 11 months ago
- ☆49Updated 9 months ago
- Enhanced Go reflection using DWARF debug information to extract function parameter names☆55Updated 3 months ago
- Ordered codes for database keys☆45Updated last year
- JSON schema support for Go programs☆80Updated 3 weeks ago
- Inference Llama 2 in Go☆39Updated 2 years ago
- VarInt: fast & memory efficient arbitrary bit width integers in Go.☆36Updated 2 years ago
- Go module for fetching embeddings from embeddings providers☆55Updated 3 months ago
- A set of tools for building parsers using the Go programming language.☆49Updated 2 years ago
- An offheap memory allocator for manual memory management in Golang☆31Updated 6 months ago
- A fast (5x) string keyed read-only map for Go - particularly good for keys using a small set of nearby runes.☆69Updated last year
- groupcache is a caching and cache-filling library, intended as a replacement for memcached in many cases.☆18Updated last year
- A Go-based SQL parsing toolkit☆39Updated last week
- 🏇🏻 generalist, fast and tiny binary parser and compiler generator, powered by Go 1.18+ Generics☆58Updated 3 years ago
- Sorted Data Structure Server - Treds is a Data Structure Server which returns data in sorted order and is the fastest prefix search serve…☆65Updated 3 weeks ago
- Fast, thread-safe arena allocators☆24Updated 2 years ago
- 📐 The fastest and smallest Go math library for constrained environments, like microcontrollers or WebAssembly.☆86Updated 3 months ago
- MUS format serializer for Go☆119Updated 2 weeks ago
- Basic Markdown parser and HTML generator☆113Updated 11 months ago
- Cookies, but with structs, for happiness.☆110Updated 5 months ago
- Scan-resistant, sharded Go cache. Admission-LFU/LRU/LFU/FIFO evictions with object pooling and optional embedded, p2p mesh cluster.☆72Updated last week
- MinLZ is a LZ77 compressor, focused on realtime data compression☆115Updated last week
- Pure Go SQL parser☆167Updated 4 months ago
- A fast file-based priority queue☆58Updated last year
- Pratt parser implementation in Go☆46Updated 3 years ago
- Structured concurrency manager for Go☆46Updated 2 years ago