dranger003 / llama.cpp-dotnetLinks
Minimal C# bindings for llama.cpp + .NET core library with API host/client.
☆73Updated 11 months ago
Alternatives and similar repositories for llama.cpp-dotnet
Users that are interested in llama.cpp-dotnet are comparing it to the libraries listed below
Sorting:
- Inference Llama 2 in one file of pure C#☆102Updated last year
- Language models in C#☆50Updated last year
- .NET wrapper for LLaMA.cpp for LLaMA language model inference on CPU. 🦙☆58Updated 2 years ago
- This project implements token calculation for OpenAI's gpt-4 and gpt-3.5-turbo model, specifically using `cl100k_base` encoding.☆81Updated this week
- Run and train Transformer based Large Language Models (LLMS) natively in .NET using TorchSharp☆24Updated last year
- Fast and memory-efficient library for WordPiece tokenization as it is used by BERT.☆50Updated 3 weeks ago
- ASP.NET Core Web, WebApi & WPF implementations for LLama.cpp & LLamaSharp☆58Updated 2 years ago
- call rwkv v4/v5/v6/v7 raven/world/finch 1B5-14B rwkv.cpp using csharp cpu/gpu (support INT4,8,Float16,32)☆35Updated 9 months ago
- C# Wrapper for StableDiffusion.cpp☆91Updated last week
- Fast local TTS inference engine in C# with ONNX runtime. Multi-speaker, multi-platform and multilingual. Integrate on your .NET projects…☆183Updated 2 months ago
- Open source project for BERT Tokenizers in C#.☆92Updated 2 years ago
- BLlamaSharp.ChatGpt.Blazor is a Blazor-based LLamaSharp Chat GPT application☆69Updated last year
- Stable Diffusion model v1.5 for TorchSharp☆19Updated last year
- Inference Stable Diffusion with C# and ONNX Runtime☆243Updated 2 years ago
- Semantic-Fleet serves as a specialized extension hub for the Semantic-Kernel ecosystem. It houses a diverse array of connectors designed …☆31Updated last month
- ☆29Updated this week
- Local Vector Database coded in c# supports Cosine Similarity, Jaccard Dissimilarity as well as Euclidean , Manhattan, ChebyShev and Canbe…☆30Updated 6 months ago
- Lightweight, In-memory, Semantic Search, Text Vector Database to embed in any .NET Application☆106Updated this week
- C# library for approximate nearest neighbors search using Hierarchical Navigable Small World graphs☆94Updated 4 months ago
- C# Stable Diffusion using ONNX Runtime☆230Updated last year
- An EXPERIMENTAL implementation of Stable Diffusion in .NET, ported from Python libraries by Huggingface☆16Updated 2 years ago
- PalmHill.BlazorChat is a chat application and API built with Blazor WebAssembly, SignalR, and WebAPI, featuring real-time LLM conversatio…☆68Updated last year
- Toy semantic search using ML.net, DistilBERT and ONNX☆9Updated 4 years ago
- GPT-2 port to C#☆10Updated 3 years ago
- BERT Model for dotnet ML☆99Updated 7 months ago
- React / NET 8 app for searching documents with a LLM. Uses ChromaDB, LlamaSharp, AllMiniLmL6v2Sharp, and ChromaDBSharp. No Python!☆20Updated last year
- C# SDK based on official HuggingFace OpenAPI specification☆46Updated last week
- Semantic Kernel connector for ONNX models.☆12Updated last year
- C# port of @karpathy https://github.com/karpathy/llm.c☆66Updated 7 months ago
- Custom TextCompletion using LLamaSharp☆26Updated 2 years ago