Ubuntu Server edition: automated setup script for Intel Arc Pro B70 GPU LLM inference server with vLLM tensor parallelism. 140 tok/s on 2x B70, 540 tok/s on 4x B70. For Windows, see arc-pro-b70-inference-setup-windows.
☆34Apr 26, 2026Updated 4 months ago
Alternatives and similar repositories for arc-pro-b70-inference-setup-ubuntu-server
Users that are interested in arc-pro-b70-inference-setup-ubuntu-server are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Makes Intel Arc Pro B70 GPUs actually fast on Ubuntu Server. 11 llama.cpp cherry-picks that fix the big B70 bugs (MoE slot-init SEGV, Q8_…☆25May 10, 2026Updated 4 months ago
- ☆61Updated this week
- Simple shortcuts and tools to save time☆14Aug 14, 2026Updated last month
- ☆45May 29, 2026Updated 3 months ago
- Odoo Test Helper☆13May 26, 2026Updated 3 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- This is a test application for NetZero battery management system.☆16Jan 30, 2019Updated 7 years ago
- This projects supports my OCA Days 2024 talk☆17Oct 6, 2024Updated last year
- Reproducible llama.cpp configs + per-category quality benches for Qwen3.6-27B on a single RTX 4090. Winners, dead ends, and the silent-co…☆24Apr 26, 2026Updated 4 months ago
- GPU overclocking utility for Blackwell RTX 50-series on Linux☆24May 26, 2026Updated 3 months ago
- Tiny evaluation of leading LLMs on competitive programming problems☆14Apr 10, 2026Updated 5 months ago
- ☆13Jun 29, 2024Updated 2 years ago
- A Python implementation of an agent swarm system that works with local LLM servers. The system allows you to create multiple agents that …☆14Nov 20, 2024Updated last year
- Converting invoice pdf to image, image to text and then get, from the text, invoice informations like invoice number or vendor name☆20Aug 4, 2023Updated 3 years ago
- EZCAD3 (Easy Computer Aided Design Version3) Mechanical CAD Package☆26Aug 12, 2019Updated 7 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- X Developer Challenge☆12Apr 25, 2024Updated 2 years ago
- DON'T PANIC (a not so useful guide to High Energy Physics software)☆14Feb 23, 2022Updated 4 years ago
- Using modal.com to process FineWeb-edu data☆21Sep 12, 2026Updated last week
- k0 - Keyboard Overlay to learn layout using keymap-drawer☆33Updated this week
- PyTorch version of TensorFlow without a PhD☆10Feb 26, 2017Updated 9 years ago
- alternative way to calculating self attention☆18May 25, 2024Updated 2 years ago
- Use Hermes-2-Pro-Mistral-7B function calling with your OpenAI API compatible code.☆18May 7, 2024Updated 2 years ago
- Add ability to interrupt own message☆14Apr 21, 2024Updated 2 years ago
- ☆21Apr 27, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Using DSPy to optimize Chat-to-SQL☆15Nov 17, 2025Updated 10 months ago
- General plug-and-play inference library for Recursive Language Models (RLMs), supporting various sandboxes.☆17Apr 26, 2026Updated 4 months ago
- a set of scripts to easily convert all training data from huggingface into alpaca instruct or sharegpt format, which should allow for eas…☆20Mar 14, 2025Updated last year
- ☆21Nov 28, 2023Updated 2 years ago
- 2D Nesting / Packing Add-In for Autodesk Fusion360 based on SVGNest☆36Aug 4, 2020Updated 6 years ago
- Project code for training LLMs to write better unit tests + code☆22May 19, 2025Updated last year
- ReasonFlow is a novel framework designed to implement o1-like reasoning capabilities in large language models.☆19Feb 25, 2025Updated last year
- Analyze exported Twitter data☆20Nov 15, 2024Updated last year
- A modern, self-hosted media request & management platform. Radarr & Sonarr are the source of truth. Oscarr is the interface.☆37Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆20Jan 27, 2024Updated 2 years ago
- Extract a single expert from a Mixture Of Experts model using slerp interpolation.☆19May 26, 2024Updated 2 years ago
- ☆22Oct 14, 2024Updated last year
- Rate limiter for LLM clients☆22Jan 30, 2025Updated last year
- Generate Large Language Model text in a container.☆19Mar 24, 2023Updated 3 years ago
- ☆21Feb 2, 2025Updated last year
- Decoder and tooling for the RDWorks .rd file format☆44Dec 27, 2023Updated 2 years ago