Alternatives and similar repositories for BertTokenizers

Users that are interested in BertTokenizers are comparing it to the libraries listed below

• Gigabyte0x1337 / BERT-ML.NET
  BERT Model for dotnet ML
  ☆99Updated 6 months ago
• georg-jung / FastBertTokenizer
  Fast and memory-efficient library for WordPiece tokenization as it is used by BERT.
  ☆50Updated 3 weeks ago
• tryAGI / Tiktoken
  This project implements token calculation for OpenAI's gpt-4 and gpt-3.5-turbo model, specifically using `cl100k_base` encoding.
  ☆81Updated this week
• curiosity-ai / hnsw-sharp
  C# library for approximate nearest neighbors search using Hierarchical Navigable Small World graphs
  ☆94Updated 3 months ago
• Build5Nines / SharpVector
  Lightweight, In-memory, Semantic Search, Text Vector Database to embed in any .NET Application
  ☆103Updated 3 weeks ago
• neon-sunset / Pinecone.NET
  Pinecone.NET is a fully-fledged C# library for the Pinecone vector database.
  ☆57Updated last year
• olegtarasov / FastText.NetWrapper
  .NET Standard wrapper for fastText library. Now works on Windows, Linux and MacOs!
  ☆76Updated last year
• aiqinxuancai / TiktokenSharp
  Token calculation for OpenAI models, using `o200k_base` `cl100k_base` `p50k_base` encoding.
  ☆122Updated 3 months ago
• tghamm / Anthropic.SDK
  An unofficial C#/.NET SDK for accessing the Anthropic Claude API. This package is not affiliated with, endorsed by, or sponsored by Anthr…
  ☆198Updated 3 weeks ago
• alexhiggins732 / BLlamaSharp.ChatGpt.Blazor
  BLlamaSharp.ChatGpt.Blazor is a Blazor-based LLamaSharp Chat GPT application
  ☆68Updated last year
• AMArostegui / SpacyDotNet
  SpacyDotNet is a .NET wrapper for the popular natural language library spaCy
  ☆35Updated 6 months ago
• trrahul / llama2.cs
  Inference Llama 2 in one file of pure C#
  ☆102Updated last year
• milvus-io / milvus-sdk-csharp
  C# SDK for Milvus.
  ☆131Updated last week
• UglyToad / PragmaticSegmenterNet
  Port of PragmaticSegmenter for sentence boundary detection
  ☆39Updated 4 years ago
• dranger003 / llama.cpp-dotnet
  Minimal C# bindings for llama.cpp + .NET core library with API host/client.
  ☆73Updated 11 months ago
• hpretila / llama.net
  .NET wrapper for LLaMA.cpp for LLaMA language model inference on CPU. 🦙
  ☆59Updated 2 years ago
• tryAGI / AutoSDK
  Automated .NET SDKs for your APIs
  ☆69Updated last week
• KeyserDSoze / Rystem.OpenAi
  .Net wrapper for OpenAI with Dependency injection integration, factory integration: you may inject more than one endpoint, azure integrat…
  ☆95Updated this week
• qdrant / qdrant-dotnet
  Qdrant .Net SDK
  ☆170Updated this week
• ksanman / AllMiniLML6v2Sharp
  net standard 2.1 Library for running Sentence Transformers All-MiniLM-L6-v2 from C#.
  ☆25Updated 11 months ago
• ebenso / TextSummarizer
  TextRank implementation for C#
  ☆58Updated 4 years ago
• aslotte / mlnet-sound-classifier
  Sound classification using ML.NET and D-CNN's
  ☆28Updated 6 years ago
• johniwasz / whetstone.chatgpt
  A simple light-weight library that wraps the Open AI API.
  ☆95Updated 3 weeks ago
• dmitry-brazhenko / SharpToken
  SharpToken is a C# library for tokenizing natural language text. It's based on the tiktoken Python library and designed to be fast and ac…
  ☆247Updated 2 months ago
• andyalm / faissmask
  A fork of https://gitlab.com/josetruyol/faisssharp
  ☆31Updated 11 months ago
• deatos / HyperVectorDB
  Local Vector Database coded in c# supports Cosine Similarity, Jaccard Dissimilarity as well as Euclidean , Manhattan, ChebyShev and Canbe…
  ☆30Updated 5 months ago
• tryAGI / Ollama
  Ollama SDK for .NET
  ☆186Updated last week
• curiosity-ai / florence2-sharp
  ☆29Updated 4 months ago
• TesAnti / LangChainChat
  LangChain Serve + Blazor chat
  ☆30Updated last year
• jeastham1993 / langchain-dotnet
  .NET implementation of the LangChain project.
  ☆71Updated 2 years ago