Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.
☆8,694Jan 28, 2026Updated last month
Alternatives and similar repositories for ipex-llm
Users that are interested in ipex-llm are comparing it to the libraries listed below
Sorting:
- BigDL: Distributed TensorFlow, Keras and PyTorch on Apache Spark/Flink & Ray☆2,692Updated this week
- TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.☆3,858Jul 10, 2023Updated 2 years ago
- Simple and Distributed Machine Learning☆5,200Feb 14, 2026Updated 2 weeks ago
- Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Juli…☆20,829Oct 25, 2023Updated 2 years ago
- Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.☆14,675Dec 1, 2025Updated 3 months ago
- Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.☆41,516Updated this week
- The open source developer platform to build AI agents and models with confidence. Enhance your AI applications with end-to-end tracking, …☆24,485Updated this week
- Step-by-step Deep Leaning Tutorials on Apache Spark using BigDL☆210Jan 3, 2023Updated 3 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆71,234Updated this week
- Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C++ and more. Runs on sing…☆28,035Updated this week
- PredictionIO, a machine learning server for developers and ML engineers.☆12,529Jan 9, 2021Updated 5 years ago
- Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and …☆14,205Updated this week
- MLeap: Deploy ML Pipelines to Production☆1,535Jan 12, 2026Updated last month
- REST job server for Apache Spark☆2,842Jul 8, 2025Updated 7 months ago
- Distributed Deep learning with Keras & Spark☆1,578May 1, 2023Updated 2 years ago
- Interactive and Reactive Data Science using Scala and Spark.☆3,152May 16, 2023Updated 2 years ago
- A Flexible and Powerful Parameter Server for large-scale machine learning☆6,784Oct 13, 2025Updated 4 months ago
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.☆41,706Updated this week
- Distributed deep learning on Hadoop and Spark clusters.☆1,263Nov 15, 2019Updated 6 years ago
- A Python package for extending the official PyTorch that can easily obtain performance on Intel platform☆2,012Feb 13, 2026Updated 2 weeks ago
- A library for efficient similarity search and clustering of dense vectors.☆39,195Updated this week
- H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random F…☆7,500Updated this week
- Apache Spark - A unified analytics engine for large-scale data processing☆42,898Updated this week
- Machine Learning Toolkit for Kubernetes☆15,462Jan 5, 2026Updated last month
- Breeze is/was a numerical processing library for Scala.☆3,457Oct 4, 2025Updated 4 months ago
- A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used …☆18,103Updated this week
- Sparkling Water provides H2O functionality inside Spark cluster☆977Nov 5, 2025Updated 3 months ago
- Distributed Neural Networks for Spark☆611Jul 23, 2020Updated 5 years ago
- TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows…☆2,272Sep 29, 2023Updated 2 years ago
- SGLang is a high-performance serving framework for large language models and multimodal models.☆23,905Updated this week
- Universal LLM Deployment Engine with ML Compilation☆22,082Updated this week
- Library for fast text representation and classification.☆26,502Mar 22, 2024Updated last year
- LLM inference in C/C++☆95,726Updated this week
- Large Language Model Text Generation Inference☆10,788Jan 8, 2026Updated last month
- A light weight, super fast, large scale machine learning library on spark .☆680Mar 23, 2018Updated 7 years ago
- Microsoft Cognitive Toolkit (CNTK), an open source deep-learning toolkit☆17,610Mar 11, 2023Updated 2 years ago
- Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more☆34,940Updated this week
- Deep Learning for humans☆63,866Updated this week
- State of the Art Natural Language Processing☆4,109Feb 23, 2026Updated last week