eliben / go-sentencepiece
Go implementation of the SentencePiece tokenizer
☆28Updated 8 months ago
Alternatives and similar repositories for go-sentencepiece:
Users that are interested in go-sentencepiece are comparing it to the libraries listed below
- XML Tokenizer is a low-memory high performance non-namespace parser library for parsing simple XML 1.0.☆42Updated this week
- Go library that implements fs.FS for Postgres using Large Objects.☆61Updated last year
- Ordered codes for database keys☆41Updated 9 months ago
- An offheap memory allocator for manual memory management in Golang☆25Updated 2 months ago
- Go module for fetching embeddings from embeddings providers☆53Updated 2 weeks ago
- A fast file-based priority queue☆58Updated last year
- A set of tools for building parsers using the Go programming language.☆44Updated 2 years ago
- ☆48Updated 3 months ago
- Generate Go enum encoding☆14Updated last month
- BTree provides a simple, ordered, in-memory data structure for Go programs.☆45Updated 3 years ago
- Simple oauth prompting☆28Updated last year
- Ungrammar implementation and API in Go☆47Updated last year
- 🔑 Experimental implementation of Passkey Autofill in Go.☆16Updated 4 months ago
- ✅ The only assertion library that works with TinyGo☆33Updated last year
- TopN collector☆23Updated 11 months ago
- nilable is a tiny Go generics library for making non-nilable values nilable☆13Updated 2 weeks ago
- A high-level interface for interacting with a Git subprocess in Go☆25Updated 6 months ago
- Scheduler of events for near real-time systems☆24Updated last year
- Wrapper for simple golang preprocessors☆26Updated 2 weeks ago
- A service for managing locks in multiprocess/distributed systems☆13Updated 2 years ago
- Golang "native" implementation of word2vec algorithm (word2vec++ port)☆23Updated 4 months ago
- Inference Llama 2 in Go☆39Updated last year
- Go UUIDv7 implementation☆24Updated 4 months ago
- VarInt: fast & memory efficient arbitrary bit width integers in Go.☆36Updated 2 years ago
- Mermaid diagrams to fsm☆22Updated 2 months ago
- Fast, thread-safe arena allocators☆22Updated 2 years ago
- mapreader is a tiny Golang library for accessing arbitrary keys from maps - especially useful when dealing with semi-unknown JSON payload…☆18Updated 8 months ago
- strftime/strptime for Go☆18Updated 2 years ago
- Write Python in Go - The most intuitive Python wrapper for Golang☆39Updated 5 months ago
- Graphic library supporting various displays☆26Updated last month