Said-Akbar / triton-gcn5Links
Triton for AMD MI25/50/60. Development repository for the Triton language and compiler
☆29Updated 4 months ago
Alternatives and similar repositories for triton-gcn5
Users that are interested in triton-gcn5 are comparing it to the libraries listed below
Sorting:
- FORK of VLLM for AMD MI25/50/60. A high-throughput and memory-efficient inference and serving engine for LLMs☆54Updated 3 months ago
- vLLM for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆150Updated last month
- ☆49Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆88Updated this week
- AI Inferencing at the Edge. A simple one-file way to run various GGML models with KoboldAI's UI with AMD ROCm offloading☆663Updated this week
- run DeepSeek-R1 GGUFs on KTransformers☆249Updated 5 months ago
- 8-bit CUDA functions for PyTorch Rocm compatible☆41Updated last year
- The HIP Environment and ROCm Kit - A lightweight open source build system for HIP and ROCm☆285Updated this week
- ☆140Updated last month
- NVIDIA Linux open GPU with P2P support☆27Updated last week
- The all-in-one RWKV runtime box with embed, RAG, AI agents, and more.☆575Updated last month
- AMD (Radeon GPU) ROCm based setup for popular AI tools on Ubuntu 24.04.1☆209Updated 5 months ago
- llama.cpp fork with additional SOTA quants and improved performance☆1,012Updated this week
- 8-bit CUDA functions for PyTorch, ported to HIP for use in AMD GPUs☆51Updated 2 years ago
- Reinforcement Learning Toolkit for RWKV.(v6,v7,ARWKV) Distillation,SFT,RLHF(DPO,ORPO), infinite context training, Aligning. Exploring the…☆48Updated last month
- Croco.Cpp is fork of KoboldCPP infering GGML/GGUF models on CPU/Cuda with KoboldAI's UI. It's powered partly by IK_LLama.cpp, and compati…☆127Updated this week
- This project is established for real-time training of the RWKV model.☆50Updated last year
- ☆13Updated 7 months ago
- RWKV infctx trainer, for training arbitary context sizes, to 10k and beyond!☆148Updated 11 months ago
- A lightweight cluster manager that turns your small fleet of nodes into one powerful computer, using Docker for environment consistency w…☆52Updated last month
- KTransformers 一键部署脚本☆49Updated 3 months ago
- Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.☆73Updated 6 months ago
- RAG SYSTEM FOR RWKV☆50Updated 8 months ago
- Running SXM2/SXM3/SXM4 NVidia data center GPUs in consumer PCs☆118Updated 2 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs (Windows build & kernels)☆111Updated 2 weeks ago
- The main repository for building Pascal-compatible versions of ML applications and libraries.☆108Updated 2 months ago
- ☆43Updated last year
- automatically quant GGUF models☆190Updated last week
- A converter and basic tester for rwkv onnx☆42Updated last year
- Fast and memory-efficient exact attention☆180Updated this week