Alternatives and similar repositories for go-tiktoken:

Users that are interested in go-tiktoken are comparing it to the libraries listed below

• hupe1980 / vecgo
  🧬🔍🗄️ Unlock the power of vector indexing and search in your Go applications with the HNSW algorithm for approximate nearest neighbor s…
  ☆11Updated 10 months ago
• sentencizer / sentencizer
  A sentence splitting (sentence boundary disambiguation) library for Go. It is rule-based and works out-of-the-box.
  ☆25Updated this week
• milosgajdos / go-embeddings
  Go module for fetching embeddings from embeddings providers
  ☆48Updated 2 months ago
• saracen / llama2.go
  Inference Llama 2 in Go
  ☆40Updated last year
• teilomillet / raggo
  A lightweight, production-ready RAG (Retrieval Augmented Generation) library in Go.
  ☆38Updated 2 months ago
• teilomillet / hapax
  The reliability layer between your code and LLM providers.
  ☆15Updated last month
• a-h / parse
  ☆46Updated 3 weeks ago
• JJBordy / rules
  Minimal rules engine, uses yaml as input
  ☆27Updated 11 months ago
• kirasystems / golem
  ☆17Updated 3 years ago
• dshills / wiggle
  Multi-Node LLM Processing Framework
  ☆16Updated 4 months ago
• haormj / llama2.go
  Inference Llama 2 in one file of pure go
  ☆16Updated last year
• neguse / goi
  goi - The “Quite OK Image” format encoder / decoder for Go.
  ☆14Updated 3 years ago
• bradfair / go-pipelines
  Helpful pipeline functionality with generics and channels.
  ☆14Updated last year
• s0rg / quadtree
  Generic, zero-alloc, 100%-test covered Quadtree for golang
  ☆37Updated last year
• eliben / go-sentencepiece
  Go implementation of the SentencePiece tokenizer
  ☆24Updated 5 months ago
• golang-design / mainthread
  🔀 schedule functions on the main thread
  ☆34Updated 2 years ago
• kelindar / timeline
  Scheduler of events for near real-time systems
  ☆24Updated last year
• a-h / lexical
  A set of tools for building parsers using the Go programming language.
  ☆43Updated last year
• guycipher / lsmt
  Embedded durable, extensive, concurrent safe, highly configurable, transactional LSM tree based key-value store package
  ☆33Updated 4 months ago
• klausbreyer / grr
  ☆16Updated last year
• hayageek / threadsafe
  A Go package providing thread-safe implementations of array, slice, map, stack and queue
  ☆22Updated 5 months ago
• abhinav / goldmark-mermaid
  Mermaid diagram support for Goldmark Markdown parser.
  ☆46Updated this week
• koteyur / physac-go
  Small demo of using physac 2d physics engine in golang
  ☆10Updated 3 years ago
• ddddddO / gdag
  Easily manage 🕸DAG🕷 with Go. DAG is an acronym for Directed Acyclic Graph. Output is in PlantUML or Mermaid format. Useful for progress…
  ☆42Updated last week
• MegaGrindStone / go-mcp
  A Go implementation of the Model Context Protocol (MCP) - an open protocol that enables seamless integration between LLM applications and…
  ☆18Updated this week
• locktopus-project / locktopus
  A service for managing locks in multiprocess/distributed systems
  ☆13Updated 2 years ago
• ebitengine / debugui
  A tiny, portable, immediate-mode UI library ported to Go and Ebitengine
  ☆47Updated 3 months ago
• shono-io / nats-ai
  A nats micro service interacting with Ollama
  ☆18Updated 7 months ago
• nikolaydubina / go-enum-encoding
  Generate Go enum encoding
  ☆14Updated this week