Alternatives and similar repositories for go-tiktoken

Users that are interested in go-tiktoken are comparing it to the libraries listed below

• hupe1980 / golc
  🚀 Building Go applications with LLMs through composability
  ☆117Updated last year
• fogfish / word2vec
  Golang "native" implementation of word2vec algorithm (word2vec++ port)
  ☆30Updated last month
• milosgajdos / go-embeddings
  Go module for fetching embeddings from embeddings providers
  ☆55Updated 4 months ago
• nlpodyssey / gotokenizers
  Go implementation of today's most used tokenizers
  ☆44Updated 4 years ago
• natexcvi / go-llm
  A framework for building LLM based agents and integrating them into larger applications.
  ☆154Updated 11 months ago
• JJBordy / rules
  Minimal rules engine, uses yaml as input
  ☆27Updated last year
• tmc / go-llama2
  Llama 2 inference in one file of pure Go
  ☆108Updated 2 years ago
• teilomillet / enzu-go
  A framework for building multi-agent AI systems. Enables LLMs to collaborate through hierarchical organization, parallel task execution, …
  ☆17Updated 11 months ago
• chriscow / minds
  A lightweight Go library for building LLM-based applications using composable handlers, inspired by the http.Handler middleware pattern.
  ☆27Updated last week
• AdvancedClimateSystems / gonnx
  Run ONNX models using Go
  ☆78Updated 7 months ago
• deepnoodle-ai / dive
  Dive is an AI toolkit for Go that can be used to create specialized AI agents, automate workflows, and quickly integrate with the leading…
  ☆98Updated last month
• saracen / llama2.go
  Inference Llama 2 in Go
  ☆39Updated 2 years ago
• MegaGrindStone / go-mcp
  A Go implementation of the Model Context Protocol (MCP) - an open protocol that enables seamless integration between LLM applications and…
  ☆44Updated 6 months ago
• hayageek / threadsafe
  A Go package providing thread-safe implementations of array, slice, map, stack and queue
  ☆28Updated 5 months ago
• sentencizer / sentencizer
  A sentence splitting (sentence boundary disambiguation) library for Go. It is rule-based and works out-of-the-box.
  ☆45Updated 2 months ago
• MegaGrindStone / go-light-rag
  A Go library implementation of LightRAG - an advanced Retrieval-Augmented Generation (RAG) system that uniquely combines vector databases…
  ☆57Updated 3 months ago
• mutablelogic / go-whisper
  Speech-to-Text in golang
  ☆149Updated this week
• Anush008 / fastembed-go
  Go implementation of @qdrant/fastembed.
  ☆91Updated last year
• klausbreyer / grr
  ☆16Updated last year
• gotzmann / fast
  FastTensors - 100% Go framework for Neural Nets
  ☆67Updated last year
• nikolaydubina / llama2.go
  LLaMA-2 in native Go
  ☆194Updated 11 months ago
• gotray / go-python
  Write Python in Go - The most intuitive Python wrapper for Golang
  ☆40Updated 11 months ago
• cornelk / llama-go
  Port of Facebook's LLaMA (Large Language Model Meta AI) in Golang with embedded C/C++
  ☆169Updated 2 years ago
• llmcontext / gomcp
  Unofficial Golang SDK for Anthropic Model Context Protocol
  ☆52Updated 9 months ago
• enetx / g
  Functional programming framework for Golang.
  ☆32Updated last week
• mariotoffia / goannoy
  go native port of annoy. Approximate Nearest Neighbors in optimized for memory usage and loading/saving to disk.
  ☆19Updated 11 months ago
• sahib / timeq
  A fast file-based priority queue
  ☆58Updated last year
• jetify-com / ai
  The AI framework for Go developers. Build powerful AI applications and agents using our free, open-source library. From Jetify, the creat…
  ☆180Updated this week
• kirasystems / golem
  ☆18Updated 4 years ago
• goptics / sqliteq
  A sqlite based queue written in go
  ☆37Updated 4 months ago