Alternatives and similar repositories for BertTokenizers:

Users that are interested in BertTokenizers are comparing it to the libraries listed below

• alexhiggins732 / BLlamaSharp.ChatGpt.Blazor
  BLlamaSharp.ChatGpt.Blazor is a Blazor-based LLamaSharp Chat GPT application
  ☆58Updated 10 months ago
• Gigabyte0x1337 / BERT-ML.NET
  BERT Model for dotnet ML
  ☆96Updated last year
• tryAGI / Tiktoken
  This project implements token calculation for OpenAI's gpt-4 and gpt-3.5-turbo model, specifically using `cl100k_base` encoding.
  ☆63Updated last week
• tghamm / Anthropic.SDK
  An unofficial C#/.NET SDK for accessing the Anthropic Claude API
  ☆84Updated this week
• georg-jung / FastBertTokenizer
  Fast and memory-efficient library for WordPiece tokenization as it is used by BERT.
  ☆42Updated last month
• Build5Nines / SharpVector
  Lightweight In-memory Text Vector Database to embed in any .NET Applications
  ☆57Updated last month
• neon-sunset / Pinecone.NET
  Pinecone.NET is a fully-fledged C# library for the Pinecone vector database.
  ☆58Updated 3 months ago
• olegtarasov / FastText.NetWrapper
  .NET Standard wrapper for fastText library. Now works on Windows, Linux and MacOs!
  ☆70Updated 3 months ago
• pgvector / pgvector-dotnet
  pgvector support for .NET (C#, F#, and Visual Basic)
  ☆149Updated last week
• qdrant / qdrant-dotnet
  Qdrant .Net SDK
  ☆107Updated this week
• curiosity-ai / hnsw-sharp
  C# library for approximate nearest neighbors search using Hierarchical Navigable Small World graphs
  ☆75Updated 3 months ago
• tryAGI / HuggingFace
  C# SDK based on official HuggingFace OpenAPI specification
  ☆31Updated this week
• jeastham1993 / langchain-dotnet
  .NET implementation of the LangChain project.
  ☆70Updated last year
• UglyToad / PragmaticSegmenterNet
  Port of PragmaticSegmenter for sentence boundary detection
  ☆33Updated 3 years ago
• lofcz / LlmTornado
  One .NET library to consume OpenAI, Anthropic, Cohere, Google, Azure, Groq, and self-hosed APIs.
  ☆42Updated this week
• K024 / llm-sharp
  Language models in C#
  ☆46Updated last year
• xbotter / semantic-kernel-LLamaSharp
  Custom TextCompletion using LLamaSharp
  ☆26Updated last year
• cristipufu / peerjs-server-net
  ASP.NET Core Server for the PeerJS library which simplifies peer-to-peer data, video, and audio calls.
  ☆32Updated 2 years ago
• AMArostegui / SpacyDotNet
  SpacyDotNet is a .NET wrapper for the popular natural language library spaCy
  ☆32Updated 3 years ago
• aiqinxuancai / TiktokenSharp
  Token calculation for OpenAI models, using `o200k_base` `cl100k_base` `p50k_base` encoding.
  ☆114Updated 3 weeks ago
• ksanman / LlmTestApp
  React / NET 8 app for searching documents with a LLM. Uses ChromaDB, LlamaSharp, AllMiniLmL6v2Sharp, and ChromaDBSharp. No Python!
  ☆17Updated last year
• milvus-io / milvus-sdk-csharp
  C# SDK for Milvus.
  ☆97Updated 6 months ago
• deatos / HyperVectorDB
  Local Vector Database coded in c# supports Cosine Similarity, Jaccard Dissimilarity as well as Euclidean , Manhattan, ChebyShev and Canbe…
  ☆14Updated 3 months ago
• KeyserDSoze / Rystem.OpenAi
  .Net wrapper for OpenAI with Dependency injection integration, factory integration: you may inject more than one endpoint, azure integrat…
  ☆94Updated this week
• SciSharp / CherubNLP
  Natural Language Processing in .NET Core
  ☆116Updated last year
• hpretila / llama.net
  .NET wrapper for LLaMA.cpp for LLaMA language model inference on CPU. 🦙
  ☆56Updated last year
• trrahul / llama2.cs
  Inference Llama 2 in one file of pure C#
  ☆96Updated 11 months ago
• nrcpp / NltkNet
  NLTK library wrapper for .NET
  ☆47Updated 3 years ago
• NickDarvey / whisper
  ☆25Updated last year
• Codeuctivity / OpenXmlPowerTools
  ☆25Updated this week