Alternatives and similar repositories for Tiktoken

Users that are interested in Tiktoken are comparing it to the libraries listed below

• saddam213 / LLamaStack
  ASP.NET Core Web, WebApi & WPF implementations for LLama.cpp & LLamaSharp
  ☆58Updated 2 years ago
• LittleLittleCloud / AgentChat
  ☆34Updated last year
• NMZivkovic / BertTokenizers
  Open source project for BERT Tokenizers in C#.
  ☆92Updated 2 years ago
• tryAGI / HuggingFace
  C# SDK based on official HuggingFace OpenAPI specification
  ☆46Updated 2 weeks ago
• tryAGI / AutoSDK
  Automated .NET SDKs for your APIs
  ☆70Updated last week
• neon-sunset / Pinecone.NET
  Pinecone.NET is a fully-fledged C# library for the Pinecone vector database.
  ☆57Updated last year
• aiqinxuancai / TiktokenSharp
  Token calculation for OpenAI models, using `o200k_base` `cl100k_base` `p50k_base` encoding.
  ☆123Updated last month
• Build5Nines / SharpVector
  Lightweight, In-memory, Semantic Search, Text Vector Database to embed in any .NET Application
  ☆112Updated 3 weeks ago
• alexhiggins732 / BLlamaSharp.ChatGpt.Blazor
  BLlamaSharp.ChatGpt.Blazor is a Blazor-based LLamaSharp Chat GPT application
  ☆69Updated last year
• xbotter / semantic-kernel-LLamaSharp
  Custom TextCompletion using LLamaSharp
  ☆26Updated 2 years ago
• milvus-io / milvus-sdk-csharp
  C# SDK for Milvus.
  ☆133Updated 2 weeks ago
• BLaZeKiLL / Codeblaze.SemanticKernel
  Some Cool Semantic Kernel Plugins
  ☆51Updated last year
• salty-flower / ModelContextProtocol.NET
  ☆81Updated 5 months ago
• MyIntelligenceAgency / semantic-fleet
  Semantic-Fleet serves as a specialized extension hub for the Semantic-Kernel ecosystem. It houses a diverse array of connectors designed …
  ☆31Updated 2 months ago
• georg-jung / FastBertTokenizer
  Fast and memory-efficient library for WordPiece tokenization as it is used by BERT.
  ☆51Updated last month
• tonybaloney / TransformersSharp
  A little wrapper for hugging face transformers in C#
  ☆112Updated 5 months ago
• dranger003 / llama.cpp-dotnet
  Minimal C# bindings for llama.cpp + .NET core library with API host/client.
  ☆73Updated last year
• Gigabyte0x1337 / BERT-ML.NET
  BERT Model for dotnet ML
  ☆101Updated 8 months ago
• sangyuxiaowu / LLamaWorker
  LLamaWorker is a HTTP API server developed based on the LLamaSharp project. It provides an OpenAI-compatible API, making it easy for deve…
  ☆77Updated 4 months ago
• laurentkempe / aiPlayground
  Some experiments around AI to learn.
  ☆78Updated 8 months ago
• KeyserDSoze / Rystem.OpenAi
  .Net wrapper for OpenAI with Dependency injection integration, factory integration: you may inject more than one endpoint, azure integrat…
  ☆94Updated this week
• rodion-m / ChatGPT_API_dotnet
  OpenAI, Azure OpenAI and OpenRouter Chat Completions (ChatGPT) .NET integration with DI, persistence and streaming support
  ☆89Updated last year
• ksanman / AllMiniLML6v2Sharp
  net standard 2.1 Library for running Sentence Transformers All-MiniLM-L6-v2 from C#.
  ☆27Updated last year
• BobLd / camelot-sharp
  A C# library to extract tabular data from PDFs (port of camelot Python version using PdfPig).
  ☆35Updated 3 years ago
• SimonCropp / PandocNet
  Conversion of documents in .net via Pandoc.
  ☆84Updated last week
• trrahul / llama2.cs
  Inference Llama 2 in one file of pure C#
  ☆101Updated last year
• fwaris / FaissNet
  ☆19Updated 2 years ago
• Jenscaasen / UniversalLLMFunctionCaller
  A planner that integrates into Semantic Kernel to enable function calling on all Chat based LLMs (Mistral, Bard, Claude, LLama etc)
  ☆57Updated last year
• Cledev-Limited / Cledev.OpenAI.Studio
  Blazor Server playground for OpenAI using Cledev.OpenAI .NET library
  ☆48Updated 2 years ago
• willibrandon / NetContextServer
  A .NET implementation of the Model Context Protocol enabling AI assistants to explore and understand .NET codebases.
  ☆27Updated 5 months ago