intel-analytics / ipex-llm
Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, GraphRAG, DeepSpeed, Axolotl, etc
☆6,726Updated this week
Related projects ⓘ
Alternatives and complementary repositories for ipex-llm
- TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.☆3,873Updated last year
- BigDL: Distributed TensorFlow, Keras and PyTorch on Apache Spark/Flink & Ray☆2,665Updated 3 weeks ago
- Integration of TensorFlow with other open-source frameworks☆1,373Updated last month
- Alluxio, data orchestration for analytics and machine learning in the cloud☆6,865Updated last week
- Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.☆14,267Updated 2 months ago
- Distributed deep learning on Hadoop and Spark clusters.☆1,265Updated 5 years ago
- PredictionIO, a machine learning server for developers and ML engineers.☆12,544Updated 3 years ago
- Distributed Deep learning with Keras & Spark☆1,574Updated last year
- Interactive and Reactive Data Science using Scala and Spark.☆3,152Updated last year
- PipelineAI☆4,173Updated 7 months ago
- Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning☆1,787Updated 3 years ago
- Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.☆34,105Updated this week
- Open source platform for the machine learning lifecycle☆18,836Updated this week
- Simple and Distributed Machine Learning☆5,069Updated this week
- Ongoing research training transformer models at scale☆10,619Updated this week
- Open deep learning compiler stack for cpu, gpu and specialized accelerators☆11,806Updated this week
- 🦉 Data Versioning and ML Experiments☆13,940Updated this week
- Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.☆6,418Updated last week
- Library for fast text representation and classification.☆25,949Updated 8 months ago
- Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Juli…☆20,784Updated last year
- Theano was a Python library that allows you to define, optimize, and evaluate mathematical expressions involving multi-dimensional arrays…☆9,905Updated 10 months ago
- Accelerate LLM with low-bit (FP4 / INT4 / FP8 / INT8) optimizations using ipex-llm☆145Updated 3 months ago
- TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows…☆2,244Updated last year
- REST job server for Apache Spark☆2,840Updated 4 months ago
- TonY is a framework to natively run deep learning frameworks on Apache Hadoop.☆708Updated last year
- Transform ML models into a native code (Java, C, Python, Go, JavaScript, Visual Basic, C#, R, PowerShell, PHP, Dart, Haskell, Ruby, F#, R…☆2,817Updated 3 months ago
- H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random F…☆6,933Updated this week