microsoft / TokenizerLinks
Typescript and .NET implementation of BPE tokenizer for OpenAI LLMs.
☆196Updated last month
Alternatives and similar repositories for Tokenizer
Users that are interested in Tokenizer are comparing it to the libraries listed below
Sorting:
- ☆203Updated last week
- This project implements token calculation for OpenAI's gpt-4 and gpt-3.5-turbo model, specifically using `cl100k_base` encoding.☆76Updated last week
- .NET implementation of the LangChain project.☆71Updated last year
- Microsoft Semantic Kernel Assistants This enables the usage of assistants for the Semantic Kernel. It provides different scenarios for t…☆110Updated 3 months ago
- SharpToken is a C# library for tokenizing natural language text. It's based on the tiktoken Python library and designed to be fast and ac…☆235Updated last year
- Pinecone.NET is a fully-fledged C# library for the Pinecone vector database.☆58Updated 8 months ago
- ☆61Updated 2 months ago
- Token calculation for OpenAI models, using `o200k_base` `cl100k_base` `p50k_base` encoding.☆120Updated 3 months ago
- pgvector support for .NET (C#, F#, and Visual Basic)☆216Updated last month
- Lightweight, In-memory, Semantic Search, Text Vector Database to embed in any .NET Application☆83Updated 2 months ago
- Qdrant .Net SDK☆140Updated last week
- Some Cool Semantic Kernel Plugins☆51Updated last year
- Semantic Kernel Playground☆18Updated last year
- A collection of tools for working with OpenAI☆99Updated 2 years ago
- Microsoft's Kernel Memory StructRAG implementation☆63Updated last month
- Sample on how to run a LLM using LM Studio and interact with the model using Semantic Kernel.☆91Updated last year
- A collection of Plugins and example console application built on the Semantic Kernel☆45Updated last year
- MCPSharp is a .NET library that helps you build Model Context Protocol (MCP) servers and clients - the standardized API protocol used by …☆293Updated last week
- An unofficial C#/.NET SDK for accessing the Anthropic Claude API☆152Updated 3 weeks ago
- Automated .NET SDKs for your APIs☆61Updated this week
- Starter Projects for Semantic Kernel☆391Updated last month
- .NET implementation of the Model Context Protocol (MCP)☆223Updated 3 months ago
- ☆85Updated 2 months ago
- The Elasticsearch adapter for Microsoft Kernel Memory.☆19Updated 10 months ago
- Open source project for BERT Tokenizers in C#.☆86Updated 2 years ago
- SQL Server connector for Semantic Kernel plugin and Kernel Memory☆52Updated 5 months ago
- Inference Llama 2 in one file of pure C#☆100Updated last year
- Semantic Kernel (SK) is a lightweight SDK enabling integration of AI Large Language Models (LLMs) with conventional programming languages…☆223Updated this week
- ☆47Updated 2 years ago
- BlazorGPT is a Blazor Server application that uses Semantic Kernel plus OpenAI, Azure OpenAI and Ollama for inference and embeddings.☆95Updated 2 months ago