dranger003 / llama.cpp-dotnetLinks
Minimal C# bindings for llama.cpp + .NET core library with API host/client.
β73Updated 11 months ago
Alternatives and similar repositories for llama.cpp-dotnet
Users that are interested in llama.cpp-dotnet are comparing it to the libraries listed below
Sorting:
- .NET wrapper for LLaMA.cpp for LLaMA language model inference on CPU. π¦β59Updated 2 years ago
- Inference Llama 2 in one file of pure C#β102Updated last year
- Language models in C#β50Updated last year
- Fast and memory-efficient library for WordPiece tokenization as it is used by BERT.β50Updated 3 weeks ago
- ASP.NET Core Web, WebApi & WPF implementations for LLama.cpp & LLamaSharpβ58Updated 2 years ago
- call rwkv v4/v5/v6/v7 raven/world/finch 1B5-14B rwkv.cpp using csharp cpu/gpu (support INT4,8,Float16,32)β35Updated 8 months ago
- Run and train Transformer based Large Language Models (LLMS) natively in .NET using TorchSharpβ24Updated last year
- This project implements token calculation for OpenAI's gpt-4 and gpt-3.5-turbo model, specifically using `cl100k_base` encoding.β81Updated this week
- C# Wrapper for StableDiffusion.cppβ90Updated this week
- Fast local TTS inference engine in C# with ONNX runtime. Multi-speaker, multi-platform and multilingual. Integrate on your .NET projectsβ¦β178Updated last month
- Inference Stable Diffusion with C# and ONNX Runtimeβ242Updated 2 years ago
- BLlamaSharp.ChatGpt.Blazor is a Blazor-based LLamaSharp Chat GPT applicationβ68Updated last year
- Local Vector Database coded in c# supports Cosine Similarity, Jaccard Dissimilarity as well as Euclidean , Manhattan, ChebyShev and Canbeβ¦β30Updated 5 months ago
- GPT-2 port to C#β10Updated 3 years ago
- β29Updated 4 months ago
- Open source project for BERT Tokenizers in C#.β90Updated 2 years ago
- Stable Diffusion model v1.5 for TorchSharpβ19Updated last year
- Semantic-Fleet serves as a specialized extension hub for the Semantic-Kernel ecosystem. It houses a diverse array of connectors designed β¦β31Updated 3 weeks ago
- C# library for approximate nearest neighbors search using Hierarchical Navigable Small World graphsβ94Updated 3 months ago
- β11Updated last year
- Semantic Kernel connector for ONNX models.β12Updated last year
- C# Stable Diffusion using ONNX Runtimeβ230Updated last year
- ONNX format parsing and manipulation in C#.β33Updated 10 months ago
- Lightweight, In-memory, Semantic Search, Text Vector Database to embed in any .NET Applicationβ103Updated 3 weeks ago
- C# Sequence to Sequence Learning with Attention using LSTM neural Networksβ26Updated 9 months ago
- LLamaWorker is a HTTP API server developed based on the LLamaSharp project. It provides an OpenAI-compatible API, making it easy for deveβ¦β77Updated 3 months ago
- .NET application for stable diffusion, Leveraging OnnxStack, Amuse seamlessly integrates many StableDiffusion capabilities all within theβ¦β16Updated last year
- Implement llama 2/3 using torchsharpβ14Updated last year
- β27Updated 2 years ago
- A fork of https://gitlab.com/josetruyol/faisssharpβ31Updated 11 months ago