Accelerate LLM with low-bit (FP4 / INT4 / FP8 / INT8) optimizations using ipex-llm
☆170May 4, 2026Updated 5 months ago
Alternatives and similar repositories for ipex-llm-tutorial
Users that are interested in ipex-llm-tutorial are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V,…☆8,845Jan 28, 2026Updated 8 months ago
- 本项目借助飞桨平台，构建起一套创新的多模型协同系统，实现 PDF 文件到 Markdown 文件的高效、精准转换。☆28Mar 25, 2025Updated last year
- This sample shows how to use the oneAPI Video Processing Library (oneVPL) to perform a single and multi-source video decode and preproces…☆15Jun 15, 2023Updated 3 years ago
- 🤗 Optimum Intel: Accelerate inference with Intel optimization tools☆623Updated this week
- ☆13Jul 24, 2026Updated 2 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Optimize with SigOpt with this standalone SigOpt client driver.☆12Aug 14, 2026Updated 2 months ago
- OpenVINO LLM Benchmark☆11Dec 7, 2023Updated 2 years ago
- 📚 Jupyter notebook tutorials for OpenVINO™☆3,227Updated this week
- Jurassic☆24Feb 6, 2024Updated 2 years ago
- This is a personal archive. Please refer to github.com/UCLA-VAST/RapidStream☆15May 31, 2022Updated 4 years ago
- Another ChatGLM2 implementation for GPTQ quantization☆55Oct 15, 2023Updated 3 years ago
- An OpenAI API compatible images server to generate or manipulate images.☆18Feb 2, 2025Updated last year
- CVPR 2024 Research Paper with Code☆47Jun 28, 2024Updated 2 years ago
- Image Search Engine with HuggingFace Sentence Transformer☆12Aug 31, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 批量文档问答对生成工具 | Batch QA Pair Generator 一个强大的文档处理工具，可以自动从各种格式的文档中提取信息并生成问答对。支持PDF、Word、Excel、Markdown等多种格式，使用大语言模型（LLM）进行智能问答生成，并提供完善的错误处理…☆18May 23, 2025Updated last year
- IBM Quantum Challenge Fall 2023☆10May 23, 2023Updated 3 years ago
- A Python package for extending the official PyTorch that can easily obtain performance on Intel platform☆2,012Mar 30, 2026Updated 6 months ago
- Code Repository for Blog - How to Productionize Large Language Models (LLMs)☆12Mar 27, 2024Updated 2 years ago
- Building reliable Retrieval Augmented Generation(RAG) AI Architecture☆13Jul 30, 2024Updated 2 years ago
- The baseline method for CCIR 22 https://www.datafountain.cn/competitions/573☆13Aug 2, 2022Updated 4 years ago
- This repository contains resources, documentation and artifacts describing LLM agents☆15Jan 22, 2025Updated last year
- ☆14Apr 22, 2024Updated 2 years ago
- In this course navigates through the LLMOps pipeline, enabling you to preprocess training data for supervised fine-tuning and deploy cust…☆16Feb 13, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Projects completed under LinuxWorld Informatics Ltd. - MLOps Training.☆12Aug 15, 2020Updated 6 years ago
- A Python package for extending the official PyTorch that can easily obtain performance on Intel platform☆46Dec 12, 2024Updated last year
- A scalable inference server for models optimized with OpenVINO™☆948Updated this week
- 基于 ZeroMQ 封装的进程间通信库，支持按 Topic 过滤的发布订阅模式和 RPC 模式通信☆15Feb 2, 2023Updated 3 years ago
- Tools for easier OpenVINO development/debugging☆10Jul 16, 2025Updated last year
- PyTorch code for our paper "Progressive Binarization with Semi-Structured Pruning for LLMs"☆13Jul 11, 2026Updated 3 months ago
- Dynamic per-token early exit for LLM inference. Skip layers tokens don't need☆34Sep 18, 2026Updated last month
- Official implementation "ChipNet: Budget-Aware Pruning with Heaviside Continuous Approximations"☆21Oct 29, 2022Updated 3 years ago
- Run Generative AI models with simple C++/Python API and using OpenVINO Runtime☆602Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Analyzing LLM Alignment via Token distribution shift☆17Jan 26, 2024Updated 2 years ago
- Code for EMNLP2019 paper: An Entity-Driven Framework for Abstractive Summarization☆14Sep 13, 2020Updated 6 years ago
- [EMNLP 2026 main] Agent-G2 : Gaussian Guidance for Agentic Reinforcement Learning☆96Sep 5, 2026Updated last month
- My Interview recording repo.☆11Mar 22, 2023Updated 3 years ago
- Workshop for Model Context Protocol☆17Mar 27, 2025Updated last year
- Cross-GPU KV Cache Marketplace☆27Nov 12, 2025Updated 11 months ago
- A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.☆89Mar 7, 2025Updated last year