microsoft / TokenizerLinks
Typescript and .NET implementation of BPE tokenizer for OpenAI LLMs.
☆208Updated 9 months ago
Alternatives and similar repositories for Tokenizer
Users that are interested in Tokenizer are comparing it to the libraries listed below
Sorting:
- ☆228Updated last week
- Microsoft Semantic Kernel Assistants This enables the usage of assistants for the Semantic Kernel. It provides different scenarios for t…☆114Updated 2 months ago
- SharpToken is a C# library for tokenizing natural language text. It's based on the tiktoken Python library and designed to be fast and ac…☆254Updated 5 months ago
- This project implements token calculation for OpenAI's gpt-4 and gpt-3.5-turbo model, specifically using `cl100k_base` encoding.☆82Updated last week
- C#/.NET SDK for A2A Protocol☆191Updated last week
- Pinecone.NET is a fully-fledged C# library for the Pinecone vector database.☆57Updated last year
- Microsoft's Kernel Memory StructRAG implementation☆74Updated 2 months ago
- A collection of tools for working with OpenAI☆101Updated 2 years ago
- .NET implementation of the LangChain project.☆71Updated 2 years ago
- Some Cool Semantic Kernel Plugins☆52Updated last year
- ☆34Updated last year
- ☆92Updated 9 months ago
- Sample on how to run a LLM using LM Studio and interact with the model using Semantic Kernel.☆99Updated last year
- Qdrant .Net SDK☆193Updated this week
- SQL Server connector for Semantic Kernel plugin and Kernel Memory☆54Updated last year
- Semantic Kernel (SK) is a lightweight SDK enabling integration of AI Large Language Models (LLMs) with conventional programming languages…☆247Updated this week
- Lightweight, In-memory, Semantic Search, Text Vector Database to embed in any .NET Application☆115Updated 3 weeks ago
- Experimental AI Agents Framework☆296Updated 7 months ago
- JavaScript/TypeScript + .NET libraries to stream updates to an object using JSONPaths and JSON Patches☆49Updated 11 months ago
- Google Gen AI Dotnet SDK provides an interface for developers to integrate Google's generative models into their .NET applications.☆87Updated last week
- .NET implementation of the Agent2Agent (A2A) protocol to enable secure, interoperable communication between autonomous agents across fram…☆50Updated this week
- A RAG evaluation pipeline for Semantic Kernel☆61Updated last year
- LangChain Serve + Blazor chat☆30Updated last year
- A comprehensive set of samples of creating and using MCP servers and clients with .NET☆147Updated last week
- ☆45Updated 2 years ago
- ☆48Updated last year
- Open source project for BERT Tokenizers in C#.☆92Updated 2 years ago
- ☆78Updated last year
- A ChatGPT plugin built with Semantic Kernel that queries a database via natural language. Winner of Microsoft's first Semantic Kernel hac…☆55Updated 2 years ago
- Sample showing how to do Retrieval Augmented Generation using .NET Aspire, Semantic Kernel, and OpenAI.☆54Updated last year