nlzy / triton-gfx906Links
triton for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60
☆28Updated 2 weeks ago
Alternatives and similar repositories for triton-gfx906
Users that are interested in triton-gfx906 are comparing it to the libraries listed below
Sorting:
- vLLM for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆280Updated this week
- Model swapping for llama.cpp (or any local OpenAI API compatible server)☆1,655Updated this week
- KTransformers 一键部署脚本☆51Updated 5 months ago
- Simple, scalable AI model deployment on GPU clusters☆3,799Updated last week
- ROCm Library Files for gfx1103 and update with others arches based on AMD GPUs for use in Windows.☆632Updated 2 weeks ago
- Run LLMs on AMD Ryzen™ AI NPUs in minutes. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.☆280Updated this week
- Get up and running with Llama 3, Mistral, Gemma, and other large language models.by adding more amd gpu support.☆1,389Updated last week
- ☆313Updated last week
- ROCm docker images with fixes/support for legecy architecture gfx803. eg.Radeon RX 590/RX 580/RX 570/RX 480☆76Updated 4 months ago
- llama.cpp fork with additional SOTA quants and improved performance☆21Updated last week
- 一套基于Vllm的显存内存混合模式大模型部署工具（图形界面），VRAMandDRAM模式虽然慢一点，但是解决了超大模型在普通家用计算机上的部署问题。☆86Updated 5 months ago
- Lemonade helps users run local LLMs with the highest performance by configuring state-of-the-art inference engines for their NPUs and GPU…☆1,385Updated this week
- Armbian with updated RKNPU drivers☆26Updated 3 weeks ago
- ☆1,163Updated this week
- Official Implementation of "KBLaM: Knowledge Base augmented Language Model"☆1,406Updated last month
- A simple, locally hosted Web Search MCP server for use with Local LLMs☆196Updated 2 months ago
- MemOS (Preview) | Intelligence Begins with Memory☆2,532Updated last week
- An open-source multi-provider (including local) fork of gemini-cli. Use whatever LLM you want to code in your terminal.☆421Updated this week
- Fresh builds of llama.cpp with AMD ROCm™ 7 acceleration☆58Updated this week
- Manifold is a platform for enabling workflow automation using AI assistants.☆463Updated this week
- Dive is an open-source MCP Host Desktop Application that seamlessly integrates with any LLMs supporting function calling capabilities. ✨☆1,594Updated last week
- OpenAlpha_Evolve is an open-source Python framework inspired by the groundbreaking research on autonomous coding agents like DeepMind's A…☆897Updated 4 months ago
- Adds 3D acceleration support for P106-090 / P106-100 / P104-100 / P104-101 / P102-100 / CMP 30HX / CMP 40HX / CMP 50HX / CMP 70HX / CMP 9…☆964Updated this week
- Run LLMs with MLX☆2,557Updated this week
- Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.☆2,688Updated this week
- AI agents can now use real Android and iOS apps, just like a human.☆1,684Updated last week
- The easiest tool for fine-tuning LLM models, synthetic data generation, and collaborating on datasets.☆4,253Updated this week
- ☆178Updated last month
- This project simplifies the installation process of likelovewant's library, making it easier for users to manage and update their AMD GPU…☆259Updated 3 weeks ago
- Bridge between Ollama and MCP servers, enabling local LLMs to use Model Context Protocol tools☆929Updated 5 months ago