tiktoken-go / tokenizer
Pure Go implementation of OpenAI's tiktoken tokenizer
☆296Updated 2 weeks ago
Related projects ⓘ
Alternatives and complementary repositories for tokenizer
- pgvector support for Go☆188Updated last week
- Fully featured, spec-compliant HTML5 server-sent events library☆338Updated 4 months ago
- go version of tiktoken☆677Updated 6 months ago
- 🚨 Design workflows of slog handlers: pipeline, middleware, fanout, routing, failover, load balancing...☆388Updated this week
- go-mask is a simple, customizable Go library for masking sensitive information.☆184Updated 4 months ago
- ☆160Updated 4 months ago
- Go generator to copy values from type to type and fields from struct to struct (copier without reflection). Generate any code based on ty…☆356Updated 8 months ago
- LLaMA-2 in native Go☆192Updated 2 months ago
- Valgo is a type-safe, expressive, and extensible validator library for Golang. Supports localization and is built with generics.☆434Updated 5 months ago
- Fast, high quality alternative to math/rand and golang.org/x/exp/rand☆236Updated 2 weeks ago
- ⏪️ Go package providing multiple queue implementations. Developed in a thread-safe generic way.☆274Updated 4 months ago
- The Go client for Chroma vector database☆76Updated 2 weeks ago
- Cybertron: the home planet of the Transformers in Go☆287Updated 5 months ago
- Optimal implementation of ordered maps for Golang - ie maps that remember the order in which keys were inserted.☆530Updated 3 months ago
- Go slog's Handler implementation to ensure correlation with Open-Telemetry spans.☆119Updated 4 months ago
- Is a general library to help modify or set data within data structures and other objects.☆234Updated last year
- ❄ An Lock Free ID Generator for Golang based on Snowflake Algorithm (Twitter announced).☆269Updated last year
- A Go tool to auto generate methods for your enums☆437Updated last month
- Anthropic Claude API wrapper for Go☆98Updated this week
- A zero-dependency generic in-memory cache Go library☆123Updated 2 months ago
- Collection of log/slog related projects.☆191Updated 3 weeks ago
- GoMLX: An Accelerated Machine Learning Framework For Go☆352Updated this week
- The world’s most powerful template engine and Go embeddable interpreter☆430Updated 3 weeks ago
- Maths includes mathematical functions not defined in the standard Go math package.☆176Updated last year
- 🚨 slog: Attribute formatting☆123Updated this week
- 🎄 Go code coverage to SVG treemap☆504Updated 2 weeks ago
- Gohalt 👮♀🛑: Fast; Simple; Powerful; Go Throttler library☆348Updated 6 months ago
- The official Go library for the OpenAI API☆414Updated this week
- NLP tokenizers written in Go language☆181Updated 5 months ago