intel / ipex-llm
Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.
☆7,675Updated this week
Alternatives and similar repositories for ipex-llm:
Users that are interested in ipex-llm are comparing it to the libraries listed below
- BigDL: Distributed TensorFlow, Keras and PyTorch on Apache Spark/Flink & Ray☆2,674Updated last week
- TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.☆3,875Updated last year
- A library for efficient similarity search and clustering of dense vectors.☆34,053Updated this week
- H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random F…☆7,092Updated this week
- Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C++ and more. Runs on sing…☆26,772Updated last week
- MLeap: Deploy ML Pipelines to Production☆1,515Updated 4 months ago
- AutoML library for deep learning☆9,210Updated 3 months ago
- Open source platform for the machine learning lifecycle☆19,972Updated this week
- Simple and Distributed Machine Learning☆5,115Updated this week
- The Triton Inference Server provides an optimized cloud and edge inferencing solution.☆8,993Updated last week
- Microsoft Distributed Machine Learning Toolkit☆2,749Updated 6 years ago
- A Python package for extending the official PyTorch that can easily obtain performance on Intel platform☆1,812Updated this week
- Sparkling Water provides H2O functionality inside Spark cluster☆968Updated 4 months ago
- Caffe2 is a lightweight, modular, and scalable deep learning framework.☆8,418Updated 2 years ago
- PipelineAI☆4,173Updated 11 months ago
- State of the Art Natural Language Processing☆3,948Updated this week
- Distributed Deep learning with Keras & Spark☆1,572Updated last year
- OpenVINO™ is an open source toolkit for optimizing and deploying AI inference☆8,061Updated this week
- Open deep learning compiler stack for cpu, gpu and specialized accelerators☆12,168Updated this week
- Distributed deep learning on Hadoop and Spark clusters.☆1,261Updated 5 years ago
- Microsoft Cognitive Toolkit (CNTK), an open source deep-learning toolkit☆17,562Updated 2 years ago
- Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet f…☆1,828Updated last year
- PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）☆22,648Updated this week
- Tool for producing high quality forecasts for time series data that has multiple seasonality with linear or non-linear growth.☆19,022Updated 5 months ago
- An open source ML system for the end-to-end data science lifecycle☆1,042Updated this week
- Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and …☆13,914Updated last week
- Machine Learning Toolkit for Kubernetes☆14,811Updated last week
- SGLang is a fast serving framework for large language models and vision language models.☆12,672Updated this week
- Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Juli…☆20,795Updated last year
- The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!☆7,561Updated this week