tryAGI / Tiktoken
This project implements token calculation for OpenAI's gpt-4 and gpt-3.5-turbo model, specifically using `cl100k_base` encoding.
☆64Updated this week
Alternatives and similar repositories for Tiktoken:
Users that are interested in Tiktoken are comparing it to the libraries listed below
- Token calculation for OpenAI models, using `o200k_base` `cl100k_base` `p50k_base` encoding.☆116Updated last month
- ☆34Updated 9 months ago
- Pinecone.NET is a fully-fledged C# library for the Pinecone vector database.☆58Updated 4 months ago
- Lightweight In-memory Text Vector Database to embed in any .NET Applications☆65Updated this week
- BLlamaSharp.ChatGpt.Blazor is a Blazor-based LLamaSharp Chat GPT application☆61Updated 11 months ago
- Custom TextCompletion using LLamaSharp☆25Updated last year
- Automated .NET SDKs for your APIs☆40Updated this week
- ASP.NET Core Web, WebApi & WPF implementations for LLama.cpp & LLamaSharp☆59Updated last year
- BERT Model for dotnet ML☆97Updated last year
- React / NET 8 app for searching documents with a LLM. Uses ChromaDB, LlamaSharp, AllMiniLmL6v2Sharp, and ChromaDBSharp. No Python!☆18Updated last year
- Open source project for BERT Tokenizers in C#.