eliben / go-sentencepiece
Go implementation of the SentencePiece tokenizer
☆24Updated 4 months ago
Alternatives and similar repositories for go-sentencepiece:
Users that are interested in go-sentencepiece are comparing it to the libraries listed below
- XML Tokenizer is a low-memory high performance non-namespace parser library for parsing simple XML 1.0.☆41Updated 2 weeks ago
- Go module for fetching embeddings from embeddings providers☆42Updated 3 weeks ago
- Extism Plug-in Development Kit (PDK) for Go☆64Updated last month
- ✅ The only assertion library that works with TinyGo☆32Updated 10 months ago
- ☆46Updated 11 months ago
- tfidf provides TF-IDF functionality☆11Updated last year
- Generate Go enum encoding☆14Updated 4 months ago
- Versioned Binary Serialization☆17Updated 6 months ago
- A lightweight, production-ready RAG (Retrieval Augmented Generation) library in Go.☆34Updated last month
- Embedded durable, extensive, concurrent safe, highly configurable, transactional LSM tree based key-value store package☆33Updated 3 months ago
- A set of tools for building parsers using the Go programming language.☆42Updated last year
- mapreader is a tiny Golang library for accessing arbitrary keys from maps - especially useful when dealing with semi-unknown JSON payload…☆18Updated 5 months ago
- Go library that implements fs.FS for Postgres using Large Objects.☆61Updated 11 months ago
- A fast file-based priority queue☆57Updated 8 months ago
- Structured concurrency manager for Go☆46Updated last year
- versatile stream IO and RPC based IPC stack for Go☆41Updated last year
- TopN collector☆23Updated 7 months ago
- Mermaid diagram support for Goldmark Markdown parser.☆43Updated this week
- VarInt: fast & memory efficient arbitrary bit width integers in Go.☆36Updated 2 years ago
- Use yaegi as a template engine.☆32Updated last year
- Dynamic localization of applications☆13Updated 9 months ago
- A purego binding for libffi.☆66Updated this week
- Phonetic encoders - bmpm, caverphone, soundex, metaphone☆19Updated last year
- Ordered codes for database keys☆41Updated 6 months ago
- perhaps the best CORS middleware library for Go☆52Updated this week
- Inference Llama 2 in Go☆40Updated last year
- Wrapper for simple golang preprocessors☆24Updated last month
- Simple internal event bus for Go applications☆29Updated last year
- Ungrammar implementation and API in Go☆44Updated 9 months ago
- ☆16Updated last year