Accelerate LLM with low-bit (FP4 / INT4 / FP8 / INT8) optimizations using ipex-llm
☆170May 4, 2026Updated 6 months ago
Alternatives and similar repositories for ipex-llm-tutorial
Users that are interested in ipex-llm-tutorial are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V,…☆8,841Jan 28, 2026Updated 9 months ago
- Step-by-step Deep Leaning Tutorials on Apache Spark using BigDL☆210Jan 3, 2023Updated 3 years ago
- 本项目借助飞桨平台，构建起一套创新的多模型协同系统，实现 PDF 文件到 Markdown 文件的高效、精准转换。☆28Mar 25, 2025Updated last year
- OpenVINO LLM Benchmark☆11Dec 7, 2023Updated 2 years ago
- 📚 Jupyter notebook tutorials for OpenVINO™☆3,238Updated this week
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Code for "All for One: LLMs Solve Mental Math at the Last Token With Information Transferred From Other Tokens"☆11Sep 11, 2025Updated last year
- A Python package for extending the official PyTorch that can easily obtain performance on Intel platform☆2,007Mar 30, 2026Updated 7 months ago
- A Gradio Web UI for running local LLM on Intel GPU (e.g., local PC with iGPU, discrete GPU such as Arc, Flex and Max) using IPEX-LLM.☆16Updated this week
- An OpenAI API compatible images server to generate or manipulate images.☆18Feb 2, 2025Updated last year
- An abstraction library for building domain-specific intelligent agents based on Large Language Models (LLMs). LLMAgent provides a core ar…☆27Feb 5, 2026Updated 9 months ago
- Audio-visual sound localization☆11Mar 8, 2023Updated 3 years ago
- ☆16Dec 16, 2024Updated last year
- State-of-the-Art Deep Learning Models in TensorFlow Modern Machine Learning in the Google Colab Ecosystem☆10Jan 24, 2023Updated 3 years ago
- Image Search Engine with HuggingFace Sentence Transformer☆12Aug 31, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- DeepSeek Cowork is a Windows desktop agent workspace built around DeepSeek-style reasoning plus tool use. It combines chat, project-scope…☆18Updated this week
- ☆14Apr 1, 2023Updated 3 years ago
- The baseline method for CCIR 22 https://www.datafountain.cn/competitions/573☆13Aug 2, 2022Updated 4 years ago
- Code Repository for Blog - How to Productionize Large Language Models (LLMs)☆12Mar 27, 2024Updated 2 years ago
- This is a repository for the course "From Beginner to LLM Developer" by Towards AI.☆13Jan 2, 2025Updated last year
- QJump NS patches and driver scripts☆12Jun 29, 2015Updated 11 years ago
- ☆14Apr 22, 2024Updated 2 years ago
- Building reliable Retrieval Augmented Generation(RAG) AI Architecture☆13Jul 30, 2024Updated 2 years ago
- Intel® Tensor Processing Primitives extension for Pytorch*☆20Aug 24, 2026Updated 2 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- This repository contains code for data preparation and experiments for pre training llm with repository level context in various ways☆12Aug 1, 2023Updated 3 years ago
- Demo on iGPU for FFmpeg decode and scale, OpenVINO inference. this is zero-copy solution, which means No frame data copy from CPU to iGPU…☆17Jan 25, 2023Updated 3 years ago
- Langchain_CrewAI_Gemini - An Gemini AI powered AI Agent (Multi-Agent) Project.☆14Mar 24, 2024Updated 2 years ago
- ☆20Feb 18, 2025Updated last year
- ☆13Jan 24, 2023Updated 3 years ago
- Implementation of Anthropic agentic workflow's using Google Gemini 2.0 Flash Experimental☆15Jan 22, 2025Updated last year
- Observability stack for vLLM inference deployments with metrics collection, sanitization, and storage using Fluent Bit and Parseable☆13Sep 30, 2025Updated last year
- Cross-GPU KV Cache Marketplace☆27Nov 12, 2025Updated last year
- In this course navigates through the LLMOps pipeline, enabling you to preprocess training data for supervised fine-tuning and deploy cust…☆16Feb 13, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Run Generative AI models with simple C++/Python API and using OpenVINO Runtime☆616Updated this week
- [ECCV 2026] UniTemp: Unlocking Video Generation in Any Temporal Order via Bidirectional Distillation☆14Jun 18, 2026Updated 4 months ago
- Code for EMNLP2019 paper: An Entity-Driven Framework for Abstractive Summarization☆14Sep 13, 2020Updated 6 years ago
- A secure Windows tray agent that bridges AI assistants and local system capabilities via MCP.☆14Mar 23, 2026Updated 7 months ago
- Infineon AURIX TC387 Unofficial MCAL☆12Aug 11, 2021Updated 5 years ago
- A scalable inference server for models optimized with OpenVINO™☆956Updated this week
- Colivara Evaluation through vidore benchmarks using ndcg@5 metric.☆12Oct 23, 2026Updated 2 weeks ago
Are these results useful?