Alternatives and similar repositories for BertTokenizers

Users that are interested in BertTokenizers are comparing it to the libraries listed below

• Gigabyte0x1337 / BERT-ML.NET
  BERT Model for dotnet ML
  ☆98Updated 2 months ago
• georg-jung / FastBertTokenizer
  Fast and memory-efficient library for WordPiece tokenization as it is used by BERT.
  ☆49Updated last month
• neon-sunset / Pinecone.NET
  Pinecone.NET is a fully-fledged C# library for the Pinecone vector database.
  ☆58Updated 8 months ago
• tryAGI / Tiktoken
  This project implements token calculation for OpenAI's gpt-4 and gpt-3.5-turbo model, specifically using `cl100k_base` encoding.
  ☆76Updated last week
• Build5Nines / SharpVector
  Lightweight, In-memory, Semantic Search, Text Vector Database to embed in any .NET Application
  ☆83Updated 2 months ago
• olegtarasov / FastText.NetWrapper
  .NET Standard wrapper for fastText library. Now works on Windows, Linux and MacOs!
  ☆75Updated 8 months ago
• curiosity-ai / hnsw-sharp
  C# library for approximate nearest neighbors search using Hierarchical Navigable Small World graphs
  ☆86Updated 3 months ago
• curiosity-ai / florence2-sharp
  ☆29Updated 7 months ago
• alexhiggins732 / BLlamaSharp.ChatGpt.Blazor
  BLlamaSharp.ChatGpt.Blazor is a Blazor-based LLamaSharp Chat GPT application
  ☆64Updated last year
• AMArostegui / SpacyDotNet
  SpacyDotNet is a .NET wrapper for the popular natural language library spaCy
  ☆34Updated last month
• tryAGI / AutoSDK
  Automated .NET SDKs for your APIs
  ☆63Updated this week
• BobLd / camelot-sharp
  A C# library to extract tabular data from PDFs (port of camelot Python version using PdfPig).
  ☆33Updated 3 years ago
• ksanman / LlmTestApp
  React / NET 8 app for searching documents with a LLM. Uses ChromaDB, LlamaSharp, AllMiniLmL6v2Sharp, and ChromaDBSharp. No Python!
  ☆18Updated last year
• qdrant / qdrant-dotnet
  Qdrant .Net SDK
  ☆140Updated last week
• jeastham1993 / langchain-dotnet
  .NET implementation of the LangChain project.
  ☆71Updated last year
• tghamm / Anthropic.SDK
  An unofficial C#/.NET SDK for accessing the Anthropic Claude API
  ☆152Updated 3 weeks ago
• aiqinxuancai / TiktokenSharp
  Token calculation for OpenAI models, using `o200k_base` `cl100k_base` `p50k_base` encoding.
  ☆120Updated 3 months ago
• elbruno / semantickernel-localLLMs
  Sample on how to run a LLM using LM Studio and interact with the model using Semantic Kernel.
  ☆91Updated last year
• Leftyx / NamedEntityRecognizer
  NER (Named Entity Recognition) implementation using a BERT/DistilBERT-based ONNX model for Token Classification in ML.NET
  ☆20Updated 4 months ago
• tryAGI / HuggingFace
  C# SDK based on official HuggingFace OpenAPI specification
  ☆44Updated last week
• UglyToad / PragmaticSegmenterNet
  Port of PragmaticSegmenter for sentence boundary detection
  ☆35Updated 3 years ago
• microsoft / Phi3-Chat-WinUI3-Sample
  ☆41Updated last year
• saddam213 / LLamaStack
  ASP.NET Core Web, WebApi & WPF implementations for LLama.cpp & LLamaSharp
  ☆58Updated last year
• milvus-io / milvus-sdk-csharp
  C# SDK for Milvus.
  ☆120Updated 11 months ago
• LittleLittleCloud / AgentChat
  ☆34Updated last year
• deatos / HyperVectorDB
  Local Vector Database coded in c# supports Cosine Similarity, Jaccard Dissimilarity as well as Euclidean , Manhattan, ChebyShev and Canbe…
  ☆19Updated 3 weeks ago
• georg-jung / FaceAiSharp
  State-of-the-art face detection and face recognition for .NET.
  ☆96Updated 3 months ago
• BLaZeKiLL / Codeblaze.SemanticKernel
  Some Cool Semantic Kernel Plugins
  ☆51Updated last year
• trrahul / llama2.cs
  Inference Llama 2 in one file of pure C#
  ☆100Updated last year
• TesAnti / LangChainChat
  LangChain Serve + Blazor chat
  ☆28Updated last year