Alternatives and similar repositories for go-tiktoken:

Users that are interested in go-tiktoken are comparing it to the libraries listed below

• teilomillet / raggo
  A lightweight, production-ready RAG (Retrieval Augmented Generation) library in Go.
  ☆51Updated 4 months ago
• sentencizer / sentencizer
  A sentence splitting (sentence boundary disambiguation) library for Go. It is rule-based and works out-of-the-box.
  ☆29Updated 2 weeks ago
• teilomillet / enzu-go
  A framework for building multi-agent AI systems. Enables LLMs to collaborate through hierarchical organization, parallel task execution, …
  ☆14Updated 4 months ago
• hupe1980 / vecgo
  🧬🔍🗄️ Unlock the power of vector indexing and search in your Go applications with the HNSW algorithm for approximate nearest neighbor s…
  ☆11Updated last year
• milosgajdos / go-embeddings
  Go module for fetching embeddings from embeddings providers
  ☆49Updated 3 months ago
• klausbreyer / grr
  ☆16Updated last year
• fira42073 / trifsm
  Mermaid diagrams to fsm
  ☆21Updated 3 weeks ago
• mmatongo / chew
  Chew is a Go library for processing various content types into markdown/plaintext.
  ☆41Updated last month
• saracen / llama2.go
  Inference Llama 2 in Go
  ☆39Updated last year
• teilomillet / hapax
  The reliability layer between your code and LLM providers.
  ☆17Updated 2 months ago
• hupe1980 / golc
  🚀 Building Go applications with LLMs through composability
  ☆110Updated 7 months ago
• eliben / go-sentencepiece
  Go implementation of the SentencePiece tokenizer
  ☆26Updated 6 months ago
• haormj / llama2.go
  Inference Llama 2 in one file of pure go
  ☆16Updated last year
• MegaGrindStone / go-mcp
  A Go implementation of the Model Context Protocol (MCP) - an open protocol that enables seamless integration between LLM applications and…
  ☆30Updated 2 weeks ago
• JJBordy / rules
  Minimal rules engine, uses yaml as input
  ☆27Updated last year
• go-aie / llmflow
  Orchestration engine & UI for your customized LLM flow.
  ☆18Updated 11 months ago
• natexcvi / go-llm
  A framework for building LLM based agents and integrating them into larger applications.
  ☆122Updated 3 months ago
• weaviate / weaviate-go-client
  ☆41Updated last month
• wneessen / niljson
  🌀 A simple Go package for (un-)marshalling null-able JSON types
  ☆19Updated 3 months ago
• joaocgduarte / csvparser
  A fast, easy-of-use and dependency free custom mapping from .csv data into Golang structs
  ☆23Updated 2 years ago
• evantbyrne / rem
  ↬ The retro Golang ORM.
  ☆28Updated 9 months ago
• abhinav / goldmark-mermaid
  Mermaid diagram support for Goldmark Markdown parser.
  ☆48Updated this week
• joshcarp / llm.go
  ☆70Updated 9 months ago
• neuml / txtai.go
  Go client for txtai
  ☆76Updated 2 weeks ago
• Broderick-Westrope / amalgo
  CLI tool for creating single-file snapshots of multiple (code) files.
  ☆11Updated 2 months ago
• gotray / go-python
  Write Python in Go - The most intuitive Python wrapper for Golang
  ☆38Updated 4 months ago
• yeicor / static-go-playground
  The full power of the Go Compiler directly in your browser, including a virtual file system implementation. Deployable as a static websit…
  ☆26Updated 2 years ago
• hayageek / threadsafe
  A Go package providing thread-safe implementations of array, slice, map, stack and queue
  ☆23Updated 7 months ago
• parakeet-nest / parakeet
  🦜🪺 Parakeet is a GoLang library, made to simplify the development of small generative AI applications with Ollama 🦙.
  ☆93Updated 2 weeks ago
• nlpodyssey / gotokenizers
  Go implementation of today's most used tokenizers
  ☆41Updated 4 years ago