microsoft / Tokenizer
Typescript and .NET implementation of BPE tokenizer for OpenAI LLMs.
☆182Updated 5 months ago
Alternatives and similar repositories for Tokenizer:
Users that are interested in Tokenizer are comparing it to the libraries listed below
- ☆61Updated last year
- Semantic Kernel (SK) is a lightweight SDK enabling integration of AI Large Language Models (LLMs) with conventional programming languages…☆205Updated last week
- Microsoft Semantic Kernel Assistants This enables the usage of assistants for the Semantic Kernel. It provides different scenarios for t…☆106Updated last month
- SQL Server connector for Semantic Kernel plugin and Kernel Memory☆51Updated 2 months ago
- ☆34Updated 11 months ago
- This project implements token calculation for OpenAI's gpt-4 and gpt-3.5-turbo model, specifically using `cl100k_base` encoding.☆73Updated 2 weeks ago
- Some Cool Semantic Kernel Plugins☆51Updated 9 months ago
- .NET implementation of the LangChain project.☆71Updated last year
- ☆199Updated this week
- ☆81Updated 5 months ago
- Token calculation for OpenAI models, using `o200k_base` `cl100k_base` `p50k_base` encoding.☆117Updated 2 weeks ago
- Starter Projects for Semantic Kernel☆368Updated 6 months ago
- SharpToken is a C# library for tokenizing natural language text. It's based on the tiktoken Python library and designed to be fast and ac…☆230Updated 10 months ago
- Tutorial for ChatGPT + Enterprise Data with Semantic Kernel, OpenAI, and Azure Cognitive Search☆156Updated last year
- Qdrant .Net SDK☆123Updated 3 weeks ago
- Awesome list of tools and projects with the awesome semantic kernel framework☆323Updated last month
- Interactive playground to experiment with Microsoft's Semantic Kernel SDK. Built with Next.js and .NET 7.☆19Updated last year
- A collection of tools for working with OpenAI☆98Updated last year
- A collection of Plugins and example console application built on the Semantic Kernel☆45Updated last year
- Microsoft's Kernel Memory StructRAG implementation☆56Updated last week
- A multi-agent chatroom for AutoGen agents☆43Updated 5 months ago
- C# SDK for Milvus.☆108Updated 8 months ago
- MCPSharp is a .NET library that helps you build Model Context Protocol (MCP) servers and clients - the standardized API protocol used by …☆237Updated 2 weeks ago
- This is a Semantic Kernel's book for beginners☆268Updated 7 months ago
- A ChatGPT plugin built with Semantic Kernel that queries a database via natural language. Winner of Microsoft's first Semantic Kernel hac…☆50Updated last year
- The Elasticsearch adapter for Microsoft Kernel Memory.☆19Updated 8 months ago
- ☆47Updated last year
- Pinecone.NET is a fully-fledged C# library for the Pinecone vector database.☆58Updated 6 months ago
- BlazorGPT is a Blazor Server application that uses Semantic Kernel plus OpenAI, Azure OpenAI and Ollama for inference and embeddings.☆88Updated this week
- ☆66Updated 5 months ago