microsoft / TokenizerLinks
Typescript and .NET implementation of BPE tokenizer for OpenAI LLMs.
☆206Updated 6 months ago
Alternatives and similar repositories for Tokenizer
Users that are interested in Tokenizer are comparing it to the libraries listed below
Sorting:
- ☆215Updated this week
- SharpToken is a C# library for tokenizing natural language text. It's based on the tiktoken Python library and designed to be fast and ac…☆245Updated 2 months ago
- This project implements token calculation for OpenAI's gpt-4 and gpt-3.5-turbo model, specifically using `cl100k_base` encoding.☆80Updated this week
- Pinecone.NET is a fully-fledged C# library for the Pinecone vector database.☆57Updated last year
- Microsoft Semantic Kernel Assistants This enables the usage of assistants for the Semantic Kernel. It provides different scenarios for t…☆113Updated last month
- C#/.NET SDK for A2A Protocol☆162Updated this week
- A collection of tools for working with OpenAI☆100Updated 2 years ago
- .NET implementation of the LangChain project.☆71Updated 2 years ago
- ☆34Updated last year
- Sample on how to run a LLM using LM Studio and interact with the model using Semantic Kernel.☆96Updated last year
- Some Cool Semantic Kernel Plugins☆51Updated last year
- Microsoft's Kernel Memory StructRAG implementation☆70Updated last month
- Qdrant .Net SDK☆165Updated last month
- SQL Server connector for Semantic Kernel plugin and Kernel Memory☆52Updated 9 months ago
- LangChain Serve + Blazor chat☆30Updated last year
- Open source project for BERT Tokenizers in C#.☆88Updated 2 years ago
- ☆47Updated last year
- Semantic Kernel (SK) is a lightweight SDK enabling integration of AI Large Language Models (LLMs) with conventional programming languages…☆240Updated last week
- JavaScript/TypeScript + .NET libraries to stream updates to an object using JSONPaths and JSON Patches☆48Updated 8 months ago
- Lightweight, In-memory, Semantic Search, Text Vector Database to embed in any .NET Application☆98Updated last week
- C# SDK based on official HuggingFace OpenAPI specification☆46Updated last week
- .NET implementation of the Agent2Agent (A2A) protocol to enable secure, interoperable communication between autonomous agents across fram…☆47Updated 2 months ago
- OllamaApiFacade is an open-source library for running a .NET backend as an Ollama API using Microsoft Semantic Kernel. It supports local …☆54Updated last month
- ☆75Updated last year
- Automated .NET SDKs for your APIs☆69Updated this week
- A RAG evaluation pipeline for Semantic Kernel☆59Updated 11 months ago
- State Manager for orchestrating AI-driven workflows with Microsoft Semantic Kernel. Simplify complex processes into modular, self-contain…☆73Updated 4 months ago
- Semantic-Fleet serves as a specialized extension hub for the Semantic-Kernel ecosystem. It houses a diverse array of connectors designed …☆31Updated this week
- The Elasticsearch adapter for Microsoft Kernel Memory.☆18Updated last year
- BlazorGPT is a Blazor Server application that uses Semantic Kernel plus OpenAI, Azure OpenAI and Ollama for inference and embeddings.☆97Updated 7 months ago