tryAGI / TiktokenLinks
This project implements token calculation for OpenAI's gpt-4 and gpt-3.5-turbo model, specifically using `cl100k_base` encoding.
☆80Updated this week
Alternatives and similar repositories for Tiktoken
Users that are interested in Tiktoken are comparing it to the libraries listed below
Sorting:
- ☆34Updated last year
- Some Cool Semantic Kernel Plugins☆52Updated last year
- Pinecone.NET is a fully-fledged C# library for the Pinecone vector database.☆58Updated 11 months ago
- BLlamaSharp.ChatGpt.Blazor is a Blazor-based LLamaSharp Chat GPT application☆66Updated last year
- Lightweight, In-memory, Semantic Search, Text Vector Database to embed in any .NET Application☆95Updated 4 months ago
- ASP.NET Core Web, WebApi & WPF implementations for LLama.cpp & LLamaSharp☆58Updated last year
- Custom TextCompletion using LLamaSharp☆26Updated last year
- C# SDK for Milvus.☆125Updated last year
- Open source project for BERT Tokenizers in C#.☆87Updated 2 years ago
- Automated .NET SDKs for your APIs☆67Updated last week
- Token calculation for OpenAI models, using `o200k_base` `cl100k_base` `p50k_base` encoding.☆120Updated 2 weeks ago
- BERT Model for dotnet ML☆98Updated 4 months ago
- C# SDK based on official HuggingFace OpenAPI specification☆45Updated this week
- net standard 2.1 Library for running Sentence Transformers All-MiniLM-L6-v2 from C#.☆24Updated 8 months ago
- A little wrapper for hugging face transformers in C#☆97Updated last month
- .Net wrapper for OpenAI with Dependency injection integration, factory integration: you may inject more than one endpoint, azure integrat…☆96Updated 3 weeks ago
- Blazor Server playground for OpenAI using Cledev.OpenAI .NET library☆48Updated 2 years ago
- Fast and memory-efficient library for WordPiece tokenization as it is used by BERT.☆50Updated last week
- Semantic-Fleet serves as a specialized extension hub for the Semantic-Kernel ecosystem. It houses a diverse array of connectors designed …☆31Updated 2 weeks ago
- A .NET implementation of the Model Context Protocol enabling AI assistants to explore and understand .NET codebases.☆22Updated last month
- Qdrant .Net SDK☆151Updated last week
- Sample on how to run a LLM using LM Studio and interact with the model using Semantic Kernel.☆95Updated last year
- Inference Llama 2 in one file of pure C#☆100Updated last year
- SharpToken is a C# library for tokenizing natural language text. It's based on the tiktoken Python library and designed to be fast and ac…☆240Updated this week
- Microsoft Semantic Kernel Assistants This enables the usage of assistants for the Semantic Kernel. It provides different scenarios for t…☆113Updated 2 weeks ago
- PalmHill.BlazorChat is a chat application and API built with Blazor WebAssembly, SignalR, and WebAPI, featuring real-time LLM conversatio…☆62Updated last year
- ☆29Updated last month
- SignalR Core C# client Blazor compatibility☆64Updated 5 years ago
- ☆208Updated this week
- BlobHelper is a common, consistent storage interface for Microsoft Azure, Amazon S3 (and S3-compliant storage), and local filesystem writ…☆62Updated 3 weeks ago