☆581Oct 28, 2026Updated this week
Alternatives and similar repositories for llm-scaler
Users that are interested in llm-scaler are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.☆545Oct 13, 2026Updated 2 weeks ago
- ☆45May 29, 2026Updated 5 months ago
- Open recipes, engine patches, and benchmark harnesses for LLM inference on Intel Arc Pro B60/B70 (Battlemage, Xe2). MoE 35B at 160 t/s de…☆188Updated this week
- The vLLM XPU kernels for Intel GPU☆79Updated this week
- ☆201Oct 22, 2026Updated last week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆61Sep 14, 2026Updated last month
- ☆74Updated this week
- Reproducible Qwen3.8-27B GPTQ INT4 + MTP4 inference on Intel Arc Pro B70 using vLLM XPU — 84.65 tok/s median.☆46Sep 9, 2026Updated last month
- AI PC starter app for doing AI image creation, image stylizing, and chatbot on a PC powered by an Intel® Arc™ GPU.☆1,021Updated this week
- SGLang kernel library for Intel XPU☆37Updated this week
- 🤗 Optimum Intel: Accelerate inference with Intel optimization tools☆623Updated this week
- Community maintained hardware plugin for vLLM on Intel Gaudi☆65Updated this week
- Agent Skills for running, benchmarking, and profiling Hugging Face models on Intel GPUs — PyTorch, vLLM-XPU, and SGLang-XPU☆45Updated this week
- Run Generative AI models with simple C++/Python API and using OpenVINO Runtime☆604Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆111Aug 28, 2026Updated 2 months ago
- PTQ-Level Efficiency, QAT-Level Accuracy | 训练后量化的效率，量化感知训练的精度☆1,694Updated this week
- llama-benchy - llama-bench style benchmarking tool for all backends☆764Jul 10, 2026Updated 3 months ago
- This repository contains Dockerfiles, scripts, yaml files, Helm charts, etc. used to scale out AI containers with versions of TensorFlow …☆79Sep 8, 2026Updated last month
- Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V,…☆8,844Jan 28, 2026Updated 9 months ago
- ☆159Oct 22, 2026Updated last week
- OpenVINO Intel NPU Compiler☆102Updated this week
- OpenAI Triton backend for Intel® GPUs☆273Updated this week
- Software kit for Qualcomm Cloud AI 100 cc☆14Oct 8, 2026Updated 3 weeks ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Fully automated installation scripts for ComfyUI optimized for Intel Arc GPUs (A-Series) and Intel Core Ultra iGPUs with XPU backend, Tri…☆162Feb 10, 2026Updated 8 months ago
- vLLM on AMD RDNA4 (gfx1201 / RX 9070 XT-9070): clone-and-docker-compose-up, with a W4A8-FP8-WMMA MoE kernel☆14Jul 18, 2026Updated 3 months ago
- a custom node set to run LLaDa-Image in ComfyUI☆16Sep 7, 2026Updated last month
- Run any model on Intel silicon☆52Oct 23, 2026Updated last week
- A Python package for extending the official PyTorch that can easily obtain performance on Intel platform☆2,011Mar 30, 2026Updated 7 months ago
- Cache-DiT Node for Comfyui☆310Aug 4, 2026Updated 2 months ago
- Multi-stage LLM agent pipeline for optimizing AI kernels on Intel GPU — from analysis to autotuning.☆23Oct 22, 2026Updated last week
- OpenVINO™ is an open source toolkit for optimizing and deploying AI inference☆11,085Updated this week
- ☆1,644Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Intel® NPU (Neural Processing Unit) Driver☆471Oct 8, 2026Updated 3 weeks ago
- With OpenVINO Test Drive, users can run large language models (LLMs) and models trained by Intel Geti on their devices, including AI PCs …☆41Sep 1, 2026Updated last month
- Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https…☆6,012Updated this week
- ☆22Sep 1, 2026Updated last month
- llama.cpp fork with additional SOTA quants and improved performance☆3,350Updated this week
- Intel® Graphics Compute Runtime for oneAPI Level Zero and OpenCL™ Driver☆1,462Updated this week
- A ComfyUI custom node for llama-swap the hot-swap model manager for llama.cpp.☆20Mar 9, 2026Updated 7 months ago