Alternatives and similar repositories for tokenizer:

Users that are interested in tokenizer are comparing it to the libraries listed below

• emluque / dscache
  Embeddable in memory key/value store for strings in golang
  ☆53Updated 6 years ago
• keybase / go-ps
  Find, list, and inspect processes from Go (golang)
  ☆82Updated 4 years ago
• jroimartin / rpcmq
  RPC protocol over AMQP
  ☆47Updated 8 years ago
• cespare / go-smaz
  A pure Go implementation of the smaz compression library for short strings.
  ☆80Updated 2 years ago
• tidwall / limiter
  A goroutine limiter for Go
  ☆79Updated 3 years ago
• arl / golq
  2D locality queries in Go
  ☆33Updated 2 years ago
• cznic / file
  github.com/cznic/file has moved to modernc.org/file
  ☆57Updated 6 years ago
• dgryski / go-shardedkv
  sharded key-value store compatible with p5-ShardedKV
  ☆36Updated 4 years ago
• celrenheit / sandflake
  Decentralized, sequential, lexicographically sortable unique id
  ☆83Updated 4 years ago
• rogpeppe / fastuuid
  Fast generation of 192-bit UUIDs
  ☆84Updated last year
• crowdriff / lru
  Golang LRU read-through cache backed by a remote store
  ☆34Updated 8 years ago
• glycerine / xcryptossh
  golang.org/x/crypto/ssh the next generation: provide idle timeouts, avoid memory leaks, and gracefully cancel connections
  ☆26Updated 3 years ago
• facebookarchive / atomicfile
  Package atomicfile provides an atomically written/replaced file.
  ☆51Updated 7 years ago
• DataDog / czlib
  Fast zlib implementation for Go
  ☆31Updated 6 months ago
• stretchr / powerwalk
  Package for concurrently walking files
  ☆103Updated 9 years ago
• alecthomas / binary
  General purpose binary encoder/decoder
  ☆48Updated last year
• klauspost / shutdown2
  Shutdown Management package for Go v2
  ☆51Updated 2 years ago
• Clever / leakybucket
  Leaky bucket implementation in Go with support for different backends (redis, in-memory)
  ☆86Updated 5 months ago
• hashicorp / net-rpc-msgpackrpc
  Library for creating Go RPC client/server.
  ☆54Updated 2 weeks ago
• streadway / simpleuuid
  Time based UUIDs useful as unique keys
  ☆57Updated 6 years ago
• hnakamur / go-scp
  [Unmaintained] A scp client library written in Go
  ☆41Updated 2 years ago
• imkira / go-interpol
  interpol is a Go package for doing format-string like string interpolation using named parameters.
  ☆44Updated 6 years ago
• cloudflare / bm
  A Golang implementation of Bentley/McIlroy long string compression
  ☆120Updated 5 months ago
• jaytaylor / go-hostsfile
  The /etc/hosts parsing and resolver library for golang
  ☆64Updated 2 years ago
• pravasan / pravasan
  Simple Migration Tool - written in Go
  ☆30Updated 6 years ago
• OneOfOne / genx
  GenX: Generics For Go, Yet Again.
  ☆36Updated 7 years ago
• facebookarchive / stats
  Package stats defines a lightweight interface for collecting statistics.
  ☆64Updated 9 years ago
• tv42 / birpc
  Bi-directional RPC library for Go, including JSON-over-WebSocket
  ☆30Updated 8 years ago
• alecthomas / unsafeslice
  Unsafe zero-copy slice casts for Go
  ☆37Updated 3 months ago
• fvbock / trie
  A Trie (Prefix Index) implementation in golang.
  ☆70Updated last year