intel / ipex-llmLinks
Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.
☆8,057Updated 2 weeks ago
Alternatives and similar repositories for ipex-llm
Users that are interested in ipex-llm are comparing it to the libraries listed below
Sorting:
- TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.☆3,872Updated last year
- Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.☆14,515Updated 2 months ago
- Open source platform for the machine learning lifecycle☆21,068Updated this week
- Low-code framework for building custom LLMs, neural networks, and other AI models☆11,506Updated last week
- Distributed Deep learning with Keras & Spark☆1,573Updated 2 years ago
- A flexible, high-performance serving system for machine learning models☆6,289Updated this week
- A Flexible and Powerful Parameter Server for large-scale machine learning☆6,757Updated this week
- Integration of TensorFlow with other open-source frameworks☆1,371Updated 9 months ago
- Distributed deep learning on Hadoop and Spark clusters.☆1,260Updated 5 years ago
- Accelerate LLM with low-bit (FP4 / INT4 / FP8 / INT8) optimizations using ipex-llm☆164Updated 2 months ago
- MLOps Tools For Managing & Orchestrating The Machine Learning LifeCycle☆3,646Updated 2 weeks ago
- oneAPI Deep Neural Network Library (oneDNN)☆3,819Updated this week
- A library for efficient similarity search and clustering of dense vectors.☆35,725Updated this week
- SGLang is a fast serving framework for large language models and vision language models.☆15,567Updated this week
- 💡 All-in-one open-source AI framework for semantic search, LLM orchestration and language model workflows☆11,140Updated this week
- The Triton Inference Server provides an optimized cloud and edge inferencing solution.☆9,384Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆50,864Updated this week
- MLeap: Deploy ML Pipelines to Production☆1,515Updated 7 months ago
- Open deep learning compiler stack for cpu, gpu and specialized accelerators☆12,398Updated this week
- Optimized primitives for collective multi-GPU communication☆3,814Updated last week
- Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.☆37,737Updated this week
- Unsupervised text tokenizer for Neural Network-based text generation.☆11,022Updated 2 months ago
- Ongoing research training transformer models at scale☆12,701Updated this week
- AutoML library for deep learning☆9,239Updated 6 months ago
- Open Source ML Model Versioning, Metadata, and Experiment Management☆1,724Updated 11 months ago
- An open source ML system for the end-to-end data science lifecycle☆1,049Updated 2 weeks ago
- Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C++ and more. Runs on sing…☆27,048Updated this week
- Simple, safe way to store and distribute tensors☆3,324Updated last week
- TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows…☆2,260Updated last year
- Large Language Model Text Generation Inference☆10,265Updated this week