Alternatives and similar repositories for Tiktoken

Users that are interested in Tiktoken are comparing it to the libraries listed below

• neon-sunset / Pinecone.NET
  Pinecone.NET is a fully-fledged C# library for the Pinecone vector database.
  ☆57Updated last year
• LittleLittleCloud / AgentChat
  ☆34Updated last year
• BLaZeKiLL / Codeblaze.SemanticKernel
  Some Cool Semantic Kernel Plugins
  ☆52Updated last year
• Gigabyte0x1337 / BERT-ML.NET
  BERT Model for dotnet ML
  ☆101Updated 9 months ago
• saddam213 / LLamaStack
  ASP.NET Core Web, WebApi & WPF implementations for LLama.cpp & LLamaSharp
  ☆59Updated 2 years ago
• Build5Nines / SharpVector
  Lightweight, In-memory, Semantic Search, Text Vector Database to embed in any .NET Application
  ☆115Updated 3 weeks ago
• milvus-io / milvus-sdk-csharp
  C# SDK for Milvus.
  ☆137Updated 2 weeks ago
• NMZivkovic / BertTokenizers
  Open source project for BERT Tokenizers in C#.
  ☆92Updated 2 years ago
• alexhiggins732 / BLlamaSharp.ChatGpt.Blazor
  BLlamaSharp.ChatGpt.Blazor is a Blazor-based LLamaSharp Chat GPT application
  ☆69Updated last year
• tryAGI / AutoSDK
  Automated .NET SDKs for your APIs
  ☆72Updated this week
• aiqinxuancai / TiktokenSharp
  Token calculation for OpenAI models, using `o200k_base` `cl100k_base` `p50k_base` encoding.
  ☆123Updated 2 months ago
• salty-flower / ModelContextProtocol.NET
  ☆80Updated 6 months ago
• tonybaloney / TransformersSharp
  A little wrapper for hugging face transformers in C#
  ☆113Updated 6 months ago
• xbotter / semantic-kernel-LLamaSharp
  Custom TextCompletion using LLamaSharp
  ☆26Updated 2 years ago
• tryAGI / HuggingFace
  C# SDK based on official HuggingFace OpenAPI specification
  ☆47Updated last week
• BobLd / camelot-sharp
  A C# library to extract tabular data from PDFs (port of camelot Python version using PdfPig).
  ☆35Updated 4 years ago
• willibrandon / NetContextServer
  A .NET implementation of the Model Context Protocol enabling AI assistants to explore and understand .NET codebases.
  ☆29Updated 6 months ago
• ksanman / AllMiniLML6v2Sharp
  net standard 2.1 Library for running Sentence Transformers All-MiniLM-L6-v2 from C#.
  ☆29Updated last year
• jchristn / Blobject
  BlobHelper is a common, consistent storage interface for Microsoft Azure, Amazon S3 (and S3-compliant storage), and local filesystem writ…
  ☆67Updated last month
• trrahul / llama2.cs
  Inference Llama 2 in one file of pure C#
  ☆101Updated 2 years ago
• georg-jung / FastBertTokenizer
  Fast and memory-efficient library for WordPiece tokenization as it is used by BERT.
  ☆53Updated 2 months ago
• laurentkempe / aiPlayground
  Some experiments around AI to learn.
  ☆78Updated 10 months ago
• SimonCropp / PandocNet
  Conversion of documents in .net via Pandoc.
  ☆88Updated this week
• MyIntelligenceAgency / semantic-fleet
  Semantic-Fleet serves as a specialized extension hub for the Semantic-Kernel ecosystem. It houses a diverse array of connectors designed …
  ☆31Updated 3 months ago
• qdrant / qdrant-dotnet
  Qdrant .Net SDK
  ☆196Updated last week
• andyalm / faissmask
  A fork of https://gitlab.com/josetruyol/faisssharp
  ☆31Updated last year
• dmitry-brazhenko / SharpToken
  SharpToken is a C# library for tokenizing natural language text. It's based on the tiktoken Python library and designed to be fast and ac…
  ☆254Updated 5 months ago
• sangyuxiaowu / LLamaWorker
  LLamaWorker is a HTTP API server developed based on the LLamaSharp project. It provides an OpenAI-compatible API, making it easy for deve…
  ☆78Updated 5 months ago
• dranger003 / llama.cpp-dotnet
  Minimal C# bindings for llama.cpp + .NET core library with API host/client.
  ☆73Updated last year
• MapsterMapper / ExpressionDebugger
  Step into debugging and generate readable script from linq expressions
  ☆38Updated 3 years ago