intel / ipex-llm
Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.
☆7,864Updated this week
Alternatives and similar repositories for ipex-llm
Users that are interested in ipex-llm are comparing it to the libraries listed below
Sorting:
- BigDL: Distributed TensorFlow, Keras and PyTorch on Apache Spark/Flink & Ray☆2,674Updated last month
- TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.☆3,874Updated last year
- oneAPI Deep Neural Network Library (oneDNN)☆3,790Updated this week
- Open source platform for the machine learning lifecycle☆20,535Updated this week
- Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.☆14,472Updated 3 weeks ago
- A library for efficient similarity search and clustering of dense vectors.☆34,963Updated this week
- Vowpal Wabbit is a machine learning system which pushes the frontier of machine learning with techniques such as online, hashing, allredu…☆8,565Updated 7 months ago
- Machine Learning Toolkit for Kubernetes☆14,966Updated last month
- Distributed deep learning on Hadoop and Spark clusters.☆1,259Updated 5 years ago
- Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Juli…☆20,804Updated last year
- MLeap: Deploy ML Pipelines to Production☆1,515Updated 5 months ago
- Open standard for machine learning interoperability☆18,949Updated this week
- A low-latency prediction-serving system☆1,416Updated 4 years ago
- An open source ML system for the end-to-end data science lifecycle☆1,044Updated this week
- An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models☆4,523Updated this week
- H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random F…☆7,156Updated this week
- Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet f…☆1,836Updated last year
- A Python package for extending the official PyTorch that can easily obtain performance on Intel platform☆1,845Updated this week
- Production-tested AI infrastructure tools for efficient AGI development and community-driven innovation☆7,765Updated this week
- Intel® Nervana™ reference deep learning framework committed to best performance on all hardware☆3,877Updated 4 years ago
- Run PyTorch LLMs locally on servers, desktop and mobile☆3,580Updated this week
- Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.☆37,050Updated this week
- MLOps Tools For Managing & Orchestrating The Machine Learning LifeCycle☆3,635Updated 3 weeks ago
- Deep universal probabilistic programming with Python and PyTorch☆8,758Updated 3 weeks ago
- Sparkling Water provides H2O functionality inside Spark cluster☆973Updated 6 months ago
- A flexible, high-performance serving system for machine learning models☆6,280Updated this week
- TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows…☆2,257Updated last year
- State of the Art Natural Language Processing☆3,973Updated this week
- SGLang is a fast serving framework for large language models and vision language models.☆14,392Updated this week
- Open deep learning compiler stack for cpu, gpu and specialized accelerators☆12,280Updated this week