microsoft / TokenizerLinks
Typescript and .NET implementation of BPE tokenizer for OpenAI LLMs.
☆194Updated last month
Alternatives and similar repositories for Tokenizer
Users that are interested in Tokenizer are comparing it to the libraries listed below
Sorting:
- Microsoft Semantic Kernel Assistants This enables the usage of assistants for the Semantic Kernel. It provides different scenarios for t…☆109Updated 3 months ago
- ☆202Updated 3 weeks ago
- Semantic Kernel (SK) is a lightweight SDK enabling integration of AI Large Language Models (LLMs) with conventional programming languages…☆219Updated this week
- SharpToken is a C# library for tokenizing natural language text. It's based on the tiktoken Python library and designed to be fast and ac…☆234Updated last year
- Starter Projects for Semantic Kernel☆387Updated 2 weeks ago
- ☆61Updated last month
- This is a Semantic Kernel's book for beginners☆286Updated 9 months ago
- Tutorial for ChatGPT + Enterprise Data with Semantic Kernel, OpenAI, and Azure Cognitive Search☆160Updated last year
- A collection of tools for working with OpenAI☆99Updated 2 years ago
- Some Cool Semantic Kernel Plugins☆51Updated 11 months ago
- .NET implementation of the LangChain project.☆71Updated last year
- Sample on how to run a LLM using LM Studio and interact with the model using Semantic Kernel.☆91Updated last year
- Token calculation for OpenAI models, using `o200k_base` `cl100k_base` `p50k_base` encoding.☆120Updated 2 months ago
- ChatGPT for your console using Semantic Kernel☆86Updated 2 years ago
- Experimental AI Agents Framework☆273Updated last month
- This project implements token calculation for OpenAI's gpt-4 and gpt-3.5-turbo model, specifically using `cl100k_base` encoding.☆75Updated last week
- Qdrant .Net SDK☆137Updated last week
- ☆82Updated last month
- SQL Server connector for Semantic Kernel plugin and Kernel Memory☆51Updated 4 months ago
- Microsoft's Kernel Memory StructRAG implementation☆61Updated 3 weeks ago
- Pinecone.NET is a fully-fledged C# library for the Pinecone vector database.☆58Updated 8 months ago
- Sample to envision intelligent apps with Microsoft's Copilot stack for AI-infused product experiences.☆737Updated 2 months ago
- Awesome list of tools and projects with the awesome semantic kernel framework☆337Updated 3 months ago
- The Blazor WebAssembly app that inspired the Microsoft //Build 2023 demo app.☆102Updated last year
- ☆41Updated last year
- ☆69Updated 7 months ago
- Ask questions to a 10K report and get answers using Microsoft Semantic Kernel and Azure OpenAI Service☆58Updated 2 years ago
- Semantic Kernel Playground☆18Updated last year
- pgvector support for .NET (C#, F#, and Visual Basic)☆211Updated last week
- A collection of Plugins and example console application built on the Semantic Kernel☆45Updated last year