tiktoken-go / tokenizerLinks
Pure Go implementation of OpenAI's tiktoken tokenizer
☆364Updated 2 weeks ago
Alternatives and similar repositories for tokenizer
Users that are interested in tokenizer are comparing it to the libraries listed below
Sorting:
- pgvector support for Go☆264Updated last month
- NLP tokenizers written in Go language☆242Updated 3 weeks ago
- The Go client for Chroma vector database☆135Updated last month
- Fully featured, spec-compliant HTML5 server-sent events library☆436Updated last month
- Anthropic Claude API wrapper for Go☆152Updated last month
- ☆159Updated 11 months ago
- 🚨 Design workflows of slog handlers: pipeline, middleware, fanout, routing, failover, load balancing...☆493Updated this week
- Is a general library to help modify or set data within data structures and other objects.☆269Updated 5 months ago
- Go client libraries for OpenAI☆452Updated last year
- Nano ID for Go☆434Updated last year
- go-mask is a simple, customizable Go library for masking sensitive information.☆193Updated 11 months ago
- Cybertron: the home planet of the Transformers in Go☆314Updated last year
- go version of tiktoken☆783Updated last year
- Valgo is a type-safe, expressive, and extensible validator library for Golang. Supports localization and is built with generics.☆448Updated last year
- Go bindings for HuggingFace Tokenizer☆149Updated 2 weeks ago
- Go implementation to calculate Levenshtein Distance.☆403Updated last month
- ⏪️ Go package providing multiple queue implementations. Developed in a thread-safe generic way.☆310Updated last month
- NLP transformers written in Go☆233Updated 2 years ago
- 🚨 slog: Attribute formatting☆173Updated last week
- Abstract JSON for Golang with JSONPath support☆275Updated 6 months ago
- Go client for Qdrant vector search engine☆232Updated last week
- Gohalt 👮♀🛑: Fast; Simple; Powerful; Go Throttler library☆351Updated last year
- A minimalist Go configuration library☆381Updated 3 weeks ago
- A key:value store/cache library written in Go generics. LRU, LFU, FIFO, MRU, Clock support.☆478Updated 4 months ago
- Generic resource pool for Go☆372Updated last month
- Copygen generates code based on Go types. Generate type-based code to copy values from type to type and fields from struct to struct by d…☆390Updated 3 months ago
- Go slog's Handler implementation to ensure correlation with Open-Telemetry spans.☆129Updated last month
- a golang library that can get client's real public ip address from http request headers☆230Updated 6 years ago
- Fast, high quality alternative to math/rand and golang.org/x/exp/rand☆238Updated 7 months ago
- 🪿 LinGoose is a Go framework for building awesome AI/LLM applications.☆782Updated 3 months ago