Alternatives and similar repositories for BertTokenizers:

Users that are interested in BertTokenizers are comparing it to the libraries listed below

• Gigabyte0x1337 / BERT-ML.NET
  BERT Model for dotnet ML
  ☆98Updated 2 weeks ago
• georg-jung / FastBertTokenizer
  Fast and memory-efficient library for WordPiece tokenization as it is used by BERT.
  ☆49Updated last week
• tryAGI / Tiktoken
  This project implements token calculation for OpenAI's gpt-4 and gpt-3.5-turbo model, specifically using `cl100k_base` encoding.
  ☆75Updated this week
• Build5Nines / SharpVector
  Lightweight, In-memory, Semantic Search, Text Vector Database to embed in any .NET Application
  ☆80Updated 2 weeks ago
• curiosity-ai / florence2-sharp
  ☆27Updated 5 months ago
• neon-sunset / Pinecone.NET
  Pinecone.NET is a fully-fledged C# library for the Pinecone vector database.
  ☆58Updated 7 months ago
• olegtarasov / FastText.NetWrapper
  .NET Standard wrapper for fastText library. Now works on Windows, Linux and MacOs!
  ☆74Updated 7 months ago
• AMArostegui / SpacyDotNet
  SpacyDotNet is a .NET wrapper for the popular natural language library spaCy
  ☆33Updated this week
• alexhiggins732 / BLlamaSharp.ChatGpt.Blazor
  BLlamaSharp.ChatGpt.Blazor is a Blazor-based LLamaSharp Chat GPT application
  ☆63Updated last year
• UglyToad / PragmaticSegmenterNet
  Port of PragmaticSegmenter for sentence boundary detection
  ☆35Updated 3 years ago
• curiosity-ai / hnsw-sharp
  C# library for approximate nearest neighbors search using Hierarchical Navigable Small World graphs
  ☆82Updated last month
• hpretila / llama.net
  .NET wrapper for LLaMA.cpp for LLaMA language model inference on CPU. 🦙
  ☆57Updated 2 years ago
• ksanman / AllMiniLML6v2Sharp
  net standard 2.1 Library for running Sentence Transformers All-MiniLM-L6-v2 from C#.
  ☆20Updated 5 months ago
• aiqinxuancai / TiktokenSharp
  Token calculation for OpenAI models, using `o200k_base` `cl100k_base` `p50k_base` encoding.
  ☆119Updated last month
• aslotte / mlnet-sound-classifier
  Sound classification using ML.NET and D-CNN's
  ☆27Updated 5 years ago
• johniwasz / whetstone.chatgpt
  A simple light-weight library that wraps the Open AI API.
  ☆95Updated last week
• saddam213 / LLamaStack
  ASP.NET Core Web, WebApi & WPF implementations for LLama.cpp & LLamaSharp
  ☆58Updated last year
• nietras / OnnxSharp
  ONNX format parsing and manipulation in C#.
  ☆28Updated 3 months ago
• tryAGI / HuggingFace
  C# SDK based on official HuggingFace OpenAPI specification
  ☆40Updated this week
• trrahul / llama2.cs
  Inference Llama 2 in one file of pure C#
  ☆101Updated last year
• jeastham1993 / langchain-dotnet
  .NET implementation of the LangChain project.
  ☆71Updated last year
• tryAGI / AutoSDK
  Automated .NET SDKs for your APIs
  ☆52Updated this week
• fwaris / FaissNet
  ☆17Updated last year
• andyalm / faissmask
  A fork of https://gitlab.com/josetruyol/faisssharp
  ☆28Updated 4 months ago
• LittleLittleCloud / StepWise
  A C# framework to build, visualize and execute event-driven workflow
  ☆116Updated last month
• georg-jung / FaceAiSharp
  State-of-the-art face detection and face recognition for .NET.
  ☆85Updated last month
• shaltielshmid / TorchSharp.PyBridge
  A library enabling easy transfer and handling of PyTorch models between .NET and Python environments
  ☆25Updated 5 months ago
• ksanman / LlmTestApp
  React / NET 8 app for searching documents with a LLM. Uses ChromaDB, LlamaSharp, AllMiniLmL6v2Sharp, and ChromaDBSharp. No Python!
  ☆18Updated last year
• qdrant / qdrant-dotnet
  Qdrant .Net SDK
  ☆131Updated 2 weeks ago
• elbruno / semantickernel-localLLMs
  Sample on how to run a LLM using LM Studio and interact with the model using Semantic Kernel.
  ☆89Updated last year