Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.
☆8,844Jan 28, 2026Updated 9 months ago
Alternatives and similar repositories for ipex-llm
Users that are interested in ipex-llm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- BigDL: Distributed TensorFlow, Keras and PyTorch on Apache Spark/Flink & Ray☆2,698Jun 12, 2026Updated 4 months ago
- TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.☆3,848Jul 10, 2023Updated 3 years ago
- Deep Learning Pipelines for Apache Spark☆1,987Mar 30, 2023Updated 3 years ago
- [DEPRECATED] Tensorflow wrapper for DataFrames on Apache Spark☆743Jul 30, 2024Updated 2 years ago
- Step-by-step Deep Leaning Tutorials on Apache Spark using BigDL☆210Jan 3, 2023Updated 3 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- A Python package for extending the official PyTorch that can easily obtain performance on Intel platform☆2,011Mar 30, 2026Updated 7 months ago
- Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark☆5,250Updated this week
- Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.☆14,674Sep 17, 2026Updated last month
- Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Juli…☆20,797Oct 25, 2023Updated 3 years ago
- Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.☆44,161Updated this week
- Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and …☆14,275Oct 5, 2026Updated 3 weeks ago
- Distributed Deep learning with Keras & Spark☆1,574May 1, 2023Updated 3 years ago
- REST job server for Apache Spark☆2,833Mar 3, 2026Updated 7 months ago
- Apache Spark - A unified analytics engine for large-scale data processing☆44,369Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- MLeap: Deploy ML Pipelines to Production☆1,545Oct 5, 2026Updated 3 weeks ago
- Breeze is/was a numerical processing library for Scala.☆3,455Oct 4, 2025Updated last year
- A Flexible and Powerful Parameter Server for large-scale machine learning☆6,796Oct 23, 2026Updated last week
- Interactive and Reactive Data Science using Scala and Spark.☆3,138May 16, 2023Updated 3 years ago
- Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C and more. Runs on single…☆28,927Updated this week
- PredictionIO, a machine learning server for developers and ML engineers.☆12,517Jan 9, 2021Updated 5 years ago
- Sparkling Water provides H2O functionality inside Spark cluster☆982Nov 5, 2025Updated 11 months ago
- The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, a…☆28,587Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆95,916Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Distributed deep learning on Hadoop and Spark clusters.☆1,262Nov 15, 2019Updated 6 years ago
- A library for efficient similarity search and clustering of dense vectors.☆41,235Updated this week
- The Cloud Native AI Platform☆15,934Sep 30, 2026Updated last month
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.☆43,275Updated this week
- TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows…☆2,279Jun 2, 2026Updated 4 months ago
- Distributed Neural Networks for Spark☆609Jul 23, 2020Updated 6 years ago
- OpenVINO™ is an open source toolkit for optimizing and deploying AI inference☆11,089Updated this week
- Distributed Deep Learning, with a focus on distributed training, using Keras and Apache Spark.☆622Jul 25, 2018Updated 8 years ago
- H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random F…☆7,519Oct 22, 2026Updated last week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning☆1,781Aug 16, 2021Updated 5 years ago
- State of the Art Natural Language Processing☆4,160Updated this week
- Universal LLM Deployment Engine with ML Compilation☆23,284Updated this week
- LLM inference in C/C++☆132,847Updated this week
- (Deprecated) Scikit-learn integration package for Apache Spark☆1,072Dec 3, 2019Updated 6 years ago
- Alluxio, data orchestration for analytics and machine learning in the cloud☆7,256Sep 1, 2026Updated last month
- A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used …☆18,940Updated this week