☆590Nov 18, 2026Updated this week
Alternatives and similar repositories for llm-scaler
Users that are interested in llm-scaler are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.☆551Updated this week
- ☆48Nov 1, 2026Updated 2 weeks ago
- Pinned Intel Arc Pro B60/B70 inference recipes, engine patches and measurement records: Qwen3.8-27B EXL3 on one card (262,144 context, 63…☆202Updated this week
- Custom fan curves + GPU power/clock tuning for Intel Arc Pro B60/B70 (Battlemage) on Linux. Confirmed on Arc Pro B60 (8086:e211).☆40Jul 9, 2026Updated 4 months ago
- Intel Arc LLM inference server (A770/B60): Qwen hybrids up to Qwen3.8-Flash-Next (512-expert MoE through an expert cache in VRAM and host…☆28Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- The vLLM XPU kernels for Intel GPU☆83Updated this week
- ☆208Updated this week
- ☆76Updated this week
- Makes Intel Arc Pro B70 GPUs actually fast on Ubuntu Server. 11 llama.cpp cherry-picks that fix the big B70 bugs (MoE slot-init SEGV, Q8_…☆28May 10, 2026Updated 6 months ago
- EXL3 (exllamav3 trellis) inference on Intel Arc Battlemage: bit-exact ESIMD kernels as a vLLM XPU plugin☆38Sep 26, 2026Updated last month
- Reproducible Qwen3.8-27B GPTQ INT4 + MTP4 inference on Intel Arc Pro B70 using vLLM XPU — 84.65 tok/s median.☆49Sep 9, 2026Updated 2 months ago
- arcinferzero☆58Updated this week
- AI PC starter app for doing AI image creation, image stylizing, and chatbot on a PC powered by an Intel® Arc™ GPU.☆1,042Oct 30, 2026Updated 2 weeks ago
- Plug-and-play llama.cpp runtime for Intel Arc GPUs. Auto-detects your card, picks safe SYCL defaults, and exposes an OpenAI-compatible AP…☆20Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Agent Skills for running, benchmarking, and profiling Hugging Face models on Intel GPUs — PyTorch, vLLM-XPU, and SGLang-XPU☆52Updated this week
- SGLang kernel library for Intel XPU☆38Updated this week
- Arc Power is a lightweight Tuning and Management Software for Intel Arc GPUs. It is powered by IGCL, RTSS, LibreHardware Monitor and OBS.☆51Oct 26, 2026Updated 3 weeks ago
- EXL3 (ExLlamaV3 trellis quantization) in stock SGLang and vLLM on RTX 3090 and Intel Arc B70, bit-exact with ExLlamaV3☆15Updated this week
- Community maintained hardware plugin for vLLM on Intel Gaudi☆68Updated this week
- ☆10Updated this week
- ☆122Updated this week
- 🤗 Optimum Intel: Accelerate inference with Intel optimization tools☆631Updated this week
- Run Generative AI models with simple C++/Python API and using OpenVINO Runtime☆624Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- llama-benchy - llama-bench style benchmarking tool for all backends☆778Jul 10, 2026Updated 4 months ago
- This repository contains Dockerfiles, scripts, yaml files, Helm charts, etc. used to scale out AI containers with versions of TensorFlow …☆78Sep 8, 2026Updated 2 months ago
- PTQ-Level Efficiency, QAT-Level Accuracy | 训练后量化的效率,量化感知训练的精度☆1,707Updated this week
- Make use of Intel Arc Series GPU to Run Ollama, StableDiffusion, Whisper and Open WebUI, for image generation, speech recognition and int…☆430Nov 1, 2026Updated 2 weeks ago
- ☆111Aug 28, 2026Updated 2 months ago
- Run LLMs on Intel Arc (B60, B580, B570, B50, B70, A770) with llama.cpp Vulkan: benchmarks, tuning, agent reliability evals, raw data.☆12Updated this week
- ☆10Updated this week
- A Python package for extending the official PyTorch that can easily obtain performance on Intel platform☆2,005Mar 30, 2026Updated 7 months ago
- a custom node set to run LLaDa-Image in ComfyUI☆16Sep 7, 2026Updated 2 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- The AI PC Application Installer provides a unified way to set up Intel AI PC development environments.☆48Nov 10, 2026Updated last week
- OpenAI Triton backend for Intel® GPUs☆275Updated this week
- OpenVINO™ is an open source toolkit for optimizing and deploying AI inference☆11,558Updated this week
- OpenVINO Intel NPU Compiler☆105Updated this week
- Fully automated installation scripts for ComfyUI optimized for Intel Arc GPUs (A-Series) and Intel Core Ultra iGPUs with XPU backend, Tri…☆162Feb 10, 2026Updated 9 months ago
- Software kit for Qualcomm Cloud AI 100 cc☆14Oct 8, 2026Updated last month
- vLLM on AMD RDNA4 (gfx1201 / RX 9070 XT-9070): clone-and-docker-compose-up, with a W4A8-FP8-WMMA MoE kernel☆14Jul 18, 2026Updated 4 months ago
Are these results useful?