Alternatives and similar repositories for llama.cpp-simple-chat-interface

Users that are interested in llama.cpp-simple-chat-interface are comparing it to the libraries listed below

• RobinQu / instinct.cpp
  instinct.cpp provides ready to use alternatives to OpenAI Assistant API and built-in utilities for developing AI Agent applications (RAG,…
  ☆47Updated 10 months ago
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆56Updated last year
• thansen0 / fastllm.cpp
  A low latency, fault tolerant API for accessing LLM's written in C++ using llama.cpp.
  ☆10Updated last month
• hscspring / llama.np
  Inference Llama/Llama2/Llama3 Modes in NumPy
  ☆20Updated last year
• xyzhang626 / embeddings.cpp
  ggml implementation of embedding models including SentenceTransformer and BGE
  ☆57Updated last year
• jerinphilip / slimt
  Inference slice of marian for bergamot's tiny11 models. Faster to compile, and wield. Fewer model-archs than bergamot-translator.
  ☆11Updated 6 months ago
• ggml-org / ci
  CI for ggml and related projects
  ☆28Updated this week
• MaggotHATE / Llama_chat
  A chat UI for Llama.cpp
  ☆13Updated this week
• nomic-ai / kompute
  General purpose GPU compute framework built on Vulkan to support 1000s of cross vendor graphics cards (AMD, Qualcomm, NVIDIA & friends). …
  ☆46Updated 2 months ago
• catid / bitnet_cpu
  Experiments with BitNet inference on CPU
  ☆54Updated last year
• rahuldshetty / starcoder.js
  Web browser version of StarCoder.cpp
  ☆45Updated last year
• ggerganov / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆26Updated last year
• kyutai-labs / kaudio
  Rust crate for some audio utilities
  ☆23Updated 2 months ago
• jndiogo / sibila
  Extract structured data from local or remote LLM models
  ☆42Updated 10 months ago
• EdVince / model_zoo
  Recording models
  ☆13Updated last year
• MollySophia / rwkv-qualcomm
  Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK
  ☆64Updated this week
• abhisheknair10 / llama3.cu
  Lightweight Llama 3 8B Inference Engine in CUDA C
  ☆47Updated last month
• calmstate / Itinerant
  A sleek, customizable interface for managing LLMs with responsive design and easy agent personalization.
  ☆15Updated 8 months ago
• guoguo1314 / llama3_learn.c
  Inference deployment of the llama3
  ☆11Updated last year
• menloresearch / cortex.llamacpp
  cortex.llamacpp is a high-efficiency C++ inference engine for edge computing. It is a dynamic library that can be loaded by any server a…
  ☆40Updated this week
• the-crypt-keeper / ggml-downloader
  Simple, Fast, Parallel Huggingface GGML model downloader written in python
  ☆24Updated last year
• kyegomez / Exa
  Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…
  ☆26Updated 6 months ago
• unit-mesh / unit-eval
  UnitEval is a benchmarking and evaluation tools for AutoDev Coder.
  ☆12Updated last year
• mobiusml / aana_sdk
  Aana SDK is a powerful framework for building AI enabled multimodal applications.
  ☆47Updated this week
• Zackriya-Solutions / diagram2graph
  An AI Vision Language Model System for extracting structured knowledge graph information(JSON) from images of process diagrams
  ☆20Updated last month
• ggerganov / vit.cpp
  Inference Vision Transformer (ViT) in plain C/C++ with ggml
  ☆30Updated last year
• Goekdeniz-Guelmez / mlx-kan
  KAN (Kolmogorov–Arnold Networks) in the MLX framework for Apple Silicon
  ☆16Updated last week
• ankan-ban / llama2.cu
  Inference Llama 2 in one file of pure Cuda
  ☆17Updated last year
• philschmid / huggingface-inferentia2-samples
  ☆10Updated 10 months ago
• EthanBnntt / tinygrad-vit
  A minimalist implementation of the ViT (Vision Transformer) model, using tinygrad
  ☆12Updated 8 months ago