dranger003 / llama.cpp-dotnet
Minimal C# bindings for llama.cpp + .NET core library with API host/client.
β66Updated 3 weeks ago
Alternatives and similar repositories for llama.cpp-dotnet:
Users that are interested in llama.cpp-dotnet are comparing it to the libraries listed below
- .NET wrapper for LLaMA.cpp for LLaMA language model inference on CPU. π¦β56Updated last year
- Language models in C#β46Updated last year
- Inference Llama 2 in one file of pure C#β96Updated 11 months ago
- Run and train Transformer based Large Language Models (LLMS) natively in .NET using TorchSharpβ21Updated 2 months ago
- ASP.NET Core Web, WebApi & WPF implementations for LLama.cpp & LLamaSharpβ59Updated last year
- An unofficial C#/.NET SDK for accessing the Anthropic Claude APIβ84Updated this week
- β19Updated 2 months ago
- React / NET 8 app for searching documents with a LLM. Uses ChromaDB, LlamaSharp, AllMiniLmL6v2Sharp, and ChromaDBSharp. No Python!β17Updated last year
- BLlamaSharp.ChatGpt.Blazor is a Blazor-based LLamaSharp Chat GPT applicationβ58Updated 10 months ago
- call rwkv v4/v5/v6 raven/world/finch 1B5-14B ggml using csharp cpu/gpu (support INT4,8,Float16,32)β32Updated 4 months ago
- Semantic Kernel connector for ONNX models.β12Updated 7 months ago
- Fast and memory-efficient library for WordPiece tokenization as it is used by BERT.β42Updated last month
- Ollama SDK for .NETβ98Updated last week
- Local Vector Database coded in c# supports Cosine Similarity, Jaccard Dissimilarity as well as Euclidean , Manhattan, ChebyShev and Canbeβ¦β14Updated 3 months ago
- Semantic-Fleet serves as a specialized extension hub for the Semantic-Kernel ecosystem. It houses a diverse array of connectors designed β¦β29Updated last year
- β10Updated 9 months ago
- GPT-2 port to C#β10Updated 2 years ago
- Stable Diffusion model v1.5 for TorchSharpβ19Updated 5 months ago
- This project implements token calculation for OpenAI's gpt-4 and gpt-3.5-turbo model, specifically using `cl100k_base` encoding.β63Updated last week
- C# Wrapper for StableDiffusion.cppβ61Updated 2 weeks ago
- C# SDK based on official HuggingFace OpenAPI specificationβ31Updated this week
- Lightweight In-memory Text Vector Database to embed in any .NET Applicationsβ57Updated last month
- Open source project for BERT Tokenizers in C#.β83Updated last year
- Implement llama 2/3 using torchsharpβ14Updated 4 months ago
- A planner that integrates into Semantic Kernel to enable function calling on all Chat based LLMs (Mistral, Bard, Claude, LLama etc)β40Updated 11 months ago
- AI Hub that unifies voice, text, and image AI models, simplifying user interaction while reducing storage needs. By automating tasks, it β¦β14Updated 4 months ago
- Port of GGML to C#β12Updated last year
- C# Stable Diffusion using ONNX Runtimeβ226Updated 7 months ago
- Inference Stable Diffusion with C# and ONNX Runtimeβ231Updated last year
- Custom TextCompletion using LLamaSharpβ26Updated last year