eliben / go-sentencepieceLinks
Go implementation of the SentencePiece tokenizer
☆42Updated last month
Alternatives and similar repositories for go-sentencepiece
Users that are interested in go-sentencepiece are comparing it to the libraries listed below
Sorting:
- Golang "native" implementation of word2vec algorithm (word2vec++ port)☆30Updated 3 months ago
- Go library that implements fs.FS for Postgres using Large Objects.☆64Updated 4 months ago
- 🏇🏻 generalist, fast and tiny binary parser and compiler generator, powered by Go 1.18+ Generics☆58Updated 3 years ago
- Basic Markdown parser and HTML generator☆113Updated last year
- Ordered codes for database keys☆45Updated last year
- A fast (5x) string keyed read-only map for Go - particularly good for keys using a small set of nearby runes.☆70Updated last year
- VarInt: fast & memory efficient arbitrary bit width integers in Go.☆37Updated 3 years ago
- XML Tokenizer is a low-memory high performance non-namespace parser library for parsing simple XML 1.0.☆43Updated last week
- Enhanced Go reflection using DWARF debug information to extract function parameter names☆57Updated 5 months ago
- tfidf provides TF-IDF functionality☆13Updated 2 years ago
- Go module for fetching embeddings from embeddings providers☆55Updated 5 months ago
- An offheap memory allocator for manual memory management in Golang☆30Updated 2 months ago
- Go code generator to access PostgreSQL tables and views on top of pgx☆23Updated 4 months ago
- Wrapper for simple golang preprocessors☆28Updated 8 months ago
- JSON schema support for Go programs☆89Updated 2 months ago
- A service for managing locks in multiprocess/distributed systems☆13Updated 2 years ago
- ☆50Updated 11 months ago
- Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration.☆230Updated last week
- Ungrammar implementation and API in Go☆48Updated last year
- Go client for txtai☆80Updated 3 weeks ago
- BTree provides a simple, ordered, in-memory data structure for Go programs.☆45Updated 3 years ago
- strftime/strptime for Go☆18Updated 3 months ago
- Scheduler of events for near real-time systems☆31Updated 4 months ago
- Hash Array Mapped Trie (HAMT) implemented in Go (1.18+ generics)☆66Updated 3 years ago
- MinLZ is a LZ77 compressor, focused on realtime data compression☆121Updated last week
- Pure Go SQL parser based on the SQLite SQL definition☆173Updated this week
- Fast, thread-safe arena allocators☆26Updated 3 weeks ago
- A set of tools for building parsers using the Go programming language.☆49Updated 2 years ago
- MUS format serializer for Go☆120Updated 2 months ago
- Neural Language Model for Go☆61Updated 2 years ago