Alternatives and similar repositories for aisaq-diskann

Users that are interested in aisaq-diskann are comparing it to the libraries listed below

• lemonade-sdk / lemonade
  Local LLM Server with GPU and NPU Acceleration
  ☆206Updated this week
• inferx-net / inferx
  InferX is a Inference Function as a Service Platform
  ☆116Updated 2 weeks ago
• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆188Updated this week
• onnx / turnkeyml
  No-code CLI designed for accelerating ONNX workflows
  ☆201Updated last month
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆67Updated 2 weeks ago
• guidance-ai / llgtrt
  TensorRT-LLM server with Structured Outputs (JSON) built with Rust
  ☆55Updated 2 months ago
• crashr / gppm
  GPU Power and Performance Manager
  ☆60Updated 9 months ago
• intel / intel-ai-assistant-builder
  Intel® AI Assistant Builder
  ☆88Updated 2 weeks ago
• xetdata / xet-core
  Rust crates for XetHub
  ☆43Updated 9 months ago
• ScalingIntelligence / good-kernels
  Samples of good AI generated CUDA kernels
  ☆84Updated last month
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆87Updated this week
• kalavai-net / kalavai-client
  Turns devices into a scalable LLM platform
  ☆150Updated last week
• BlinkDL / fast.c
  Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.
  ☆72Updated 5 months ago
• amanvirparhar / elara
  A simple tool to anonymize LLM prompts.
  ☆63Updated 5 months ago
• okuvshynov / cubestat
  Horizon chart for CPU/GPU/Neural Engine utilization monitoring. Supports Apple M1-M4, Nvidia GPUs, AMD GPUs
  ☆25Updated 3 weeks ago
• sasha0552 / nvidia-pstated
  A daemon that automatically manages the performance states of NVIDIA GPUs.
  ☆89Updated last month
• ROCm / TheRock
  The HIP Environment and ROCm Kit - A lightweight open source build system for HIP and ROCm
  ☆234Updated this week
• ROCm / aiter
  AI Tensor Engine for ROCm
  ☆232Updated this week
• teabranch / open-responses-server
  Wraps any OpenAI API interface as Responses with MCPs support so it supports Codex. Adding any missing stateful features. Ollama and Vllm…
  ☆72Updated 2 weeks ago
• DeployQL / LintDB
  Vector Database with support for late interaction and token level embeddings.
  ☆55Updated 3 weeks ago
• Derecho-Project / cascade
  A C++ distributed framework for responsive Cloud applications.
  ☆79Updated this week
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆89Updated 2 weeks ago
• powerserve-project / PowerServe
  High-speed and easy-use LLM serving framework for local deployment
  ☆112Updated 4 months ago
• facebookresearch / DCPerf
  DCPerf benchmark suite for hyperscale cloud applications
  ☆193Updated this week
• theroyallab / YALS
  ☆80Updated this week
• sushrut141 / vamana
  Exploration of Vector database Index for fast approximate nearest neighbour search.
  ☆28Updated 11 months ago
• aidatatools / ollama-benchmark
  LLM Benchmark for Throughput via Ollama (Local LLMs)
  ☆255Updated 2 weeks ago
• tenstorrent / tt-smi
  Tenstorrent console based hardware information program
  ☆45Updated last week
• prem-research / prem-operator
  📡 Deploy AI models and apps to Kubernetes without developing a hernia
  ☆32Updated last year
• kriztalz / SharkMCP
  A tshark MCP server for packet capture and analysis
  ☆18Updated last month