Alternatives and similar repositories for tokenizer:

Users that are interested in tokenizer are comparing it to the libraries listed below

• emluque / dscache
  Embeddable in memory key/value store for strings in golang
  ☆53Updated 6 years ago
• bradfitz / slice
  The slice package sorts Go slices.
  ☆111Updated 6 years ago
• cznic / file
  github.com/cznic/file has moved to modernc.org/file
  ☆57Updated 6 years ago
• crowdriff / lru
  Golang LRU read-through cache backed by a remote store
  ☆34Updated 8 years ago
• stretchr / powerwalk
  Package for concurrently walking files
  ☆103Updated 9 years ago
• facebookarchive / stats
  Package stats defines a lightweight interface for collecting statistics.
  ☆64Updated 9 years ago
• jroimartin / rpcmq
  RPC protocol over AMQP
  ☆47Updated 8 years ago
• celrenheit / sandflake
  Decentralized, sequential, lexicographically sortable unique id
  ☆83Updated 4 years ago
• Clever / leakybucket
  Leaky bucket implementation in Go with support for different backends (redis, in-memory)
  ☆87Updated 6 months ago
• arl / golq
  2D locality queries in Go
  ☆33Updated 3 years ago
• toberndo / go-stree
  A package for Go that can be used for range queries on large number of intervals
  ☆42Updated 8 years ago
• cespare / go-smaz
  A pure Go implementation of the smaz compression library for short strings.
  ☆80Updated 2 years ago
• sger / go-apns2
  Go package for HTTP/2 Apple Push Notification Service.
  ☆54Updated 7 years ago
• armon / circbuf
  Golang circular (ring) buffer
  ☆174Updated 2 years ago
• mattevans / distil
  💧 In memory dataset filtering
  ☆49Updated 3 years ago
• sasha-s / go-inline
  Generic Data Structures/Algorithms in golang.
  ☆53Updated 8 years ago
• hashicorp / net-rpc-msgpackrpc
  Library for creating Go RPC client/server.
  ☆54Updated last month
• mikegleasonjr / forwardcache
  A distributed forward caching proxy for Go's http.Client supporting TLS
  ☆31Updated 7 years ago
• tywkeene / go-fsevents
  Recursive filesystem event watcher using inotify in golang
  ☆122Updated 2 years ago
• cloudflare / bm
  A Golang implementation of Bentley/McIlroy long string compression
  ☆120Updated 6 months ago
• glycerine / xcryptossh
  golang.org/x/crypto/ssh the next generation: provide idle timeouts, avoid memory leaks, and gracefully cancel connections
  ☆26Updated 3 years ago
• gigawattio / metaflector
  Higher-level reflect-based capabilities for inspecting objects and structs
  ☆70Updated 7 years ago
• pierrec / xxHash
  Pure Go implementation of xxHash (32 and 64 bits versions)
  ☆59Updated 4 years ago
• arl / go-rquad
  State of the art point location and neighbour finding algorithms for region quadtrees, in Go
  ☆136Updated 2 years ago
• adamliesko / retry
  Configurable Go retry package, which invokes flaky functions until they succeed.
  ☆47Updated 5 years ago
• rosspeoples / mydis-old
  Distributed, reliable database and cache library, server, and client. Inspired by Redis.
  ☆59Updated 7 years ago
• karlseguin / rcache
  A simple cache meant to hold a small number of values
  ☆30Updated 6 years ago
• jaytaylor / go-hostsfile
  The /etc/hosts parsing and resolver library for golang
  ☆65Updated 2 years ago
• ernesto-jimenez / gogen
  A set of go packages and command line tools to generate Go code
  ☆94Updated 7 years ago
• ian-kent / linkio
  Simulate network link speed
  ☆54Updated 7 years ago