tryAGI / TiktokenLinks
This project implements token calculation for OpenAI's gpt-4 and gpt-3.5-turbo model, specifically using `cl100k_base` encoding.
☆81Updated this week
Alternatives and similar repositories for Tiktoken
Users that are interested in Tiktoken are comparing it to the libraries listed below
Sorting:
- Pinecone.NET is a fully-fledged C# library for the Pinecone vector database.☆57Updated last year
- ☆34Updated last year
- Open source project for BERT Tokenizers in C#.☆92Updated 2 years ago
- Token calculation for OpenAI models, using `o200k_base` `cl100k_base` `p50k_base` encoding.☆122Updated 3 weeks ago
- BERT Model for dotnet ML☆99Updated 7 months ago
- Custom TextCompletion using LLamaSharp☆26Updated 2 years ago
- BLlamaSharp.ChatGpt.Blazor is a Blazor-based LLamaSharp Chat GPT application☆69Updated last year
- ASP.NET Core Web, WebApi & WPF implementations for LLama.cpp & LLamaSharp☆58Updated 2 years ago
- Lightweight, In-memory, Semantic Search, Text Vector Database to embed in any .NET Application☆106Updated this week
- Automated .NET SDKs for your APIs☆69Updated last week
- A little wrapper for hugging face transformers in C#☆112Updated 4 months ago
- Minimal C# bindings for llama.cpp + .NET core library with API host/client.☆73Updated 11 months ago
- SharpToken is a C# library for tokenizing natural language text. It's based on the tiktoken Python library and designed to be fast and ac…☆249Updated 3 months ago
- C# SDK based on official HuggingFace OpenAPI specification☆46Updated last week
- A C# library to extract tabular data from PDFs (port of camelot Python version using PdfPig).☆35Updated 3 years ago
- Some Cool Semantic Kernel Plugins☆51Updated last year
- C# SDK for Milvus.☆131Updated 3 weeks ago
- Fast and memory-efficient library for WordPiece tokenization as it is used by BERT.☆50Updated 3 weeks ago
- LangChain Serve + Blazor chat☆30Updated last year
- Some experiments around AI to learn.☆76Updated 8 months ago
- BlobHelper is a common, consistent storage interface for Microsoft Azure, Amazon S3 (and S3-compliant storage), and local filesystem writ…☆65Updated 4 months ago
- Qdrant .Net SDK☆175Updated 3 weeks ago
- Inference Llama 2 in one file of pure C#☆102Updated last year
- Blazor Server playground for OpenAI using Cledev.OpenAI .NET library☆48Updated 2 years ago
- .Net wrapper for OpenAI with Dependency injection integration, factory integration: you may inject more than one endpoint, azure integrat…☆94Updated last week
- ☆81Updated 4 months ago
- .NET Standard wrapper for fastText library. Now works on Windows, Linux and MacOs!☆76Updated last year
- LLamaWorker is a HTTP API server developed based on the LLamaSharp project. It provides an OpenAI-compatible API, making it easy for deve…☆77Updated 3 months ago
- Conversion of documents in .net via Pandoc.☆83Updated last week
- C# library for approximate nearest neighbors search using Hierarchical Navigable Small World graphs☆94Updated 4 months ago