Alternatives and similar repositories for triton-gcn5

Users that are interested in triton-gcn5 are comparing it to the libraries listed below

• Said-Akbar / vllm-rocm
  FORK of VLLM for AMD MI25/50/60. A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆52Updated 2 months ago
• nlzy / vllm-gfx906
  vLLM for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60
  ☆111Updated last week
• ROCm / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆85Updated this week
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆652Updated this week
• ssiu / flash-attention-turing
  ☆43Updated this week
• ubergarm / r1-ktransformers-guide
  run DeepSeek-R1 GGUFs on KTransformers
  ☆242Updated 4 months ago
• Nexesenex / croco.cpp
  Croco.Cpp is fork of KoboldCPP infering GGML/GGUF models on CPU/Cuda with KoboldAI's UI. It's powered partly by IK_LLama.cpp, and compati…
  ☆111Updated this week
• aikitoria / open-gpu-kernel-modules
  NVIDIA Linux open GPU with P2P support
  ☆25Updated last month
• ROCm / flash-attention
  Fast and memory-efficient exact attention
  ☆177Updated this week
• undreamai / LlamaLib
  ☆14Updated this week
• harrisonvanderbyl / rwkv-cpp-accelerated
  A torchless, c++ rwkv implementation using 8bit quantization, written in cuda/hip/vulkan for maximum compatibility and minimum dependenci…
  ☆312Updated last year
• KohakuBlueleaf / HakuRiver
  A lightweight cluster manager that turns your small fleet of nodes into one powerful computer, using Docker for environment consistency w…
  ☆52Updated 3 weeks ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆187Updated this week
• BlinkDL / fast.c
  Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.
  ☆72Updated 5 months ago
• ROCm / TheRock
  The HIP Environment and ROCm Kit - A lightweight open source build system for HIP and ROCm
  ☆234Updated this week
• RWKV / rwkv-onnx
  A converter and basic tester for rwkv onnx
  ☆42Updated last year
• Ai00-X / ai00_server
  The all-in-one RWKV runtime box with embed, RAG, AI agents, and more.
  ☆571Updated last month
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆67Updated 2 weeks ago
• SystemPanic / vllm-windows
  A high-throughput and memory-efficient inference and serving engine for LLMs (Windows build & kernels)
  ☆93Updated 3 weeks ago
• gpustack / llama-box
  LM inference server implementation based on *.cpp.
  ☆236Updated this week
• arlo-phoenix / bitsandbytes-rocm-5.6
  8-bit CUDA functions for PyTorch Rocm compatible
  ☆41Updated last year
• theroyallab / YALS
  ☆80Updated this week
• JL-er / RWKV-PEFT
  ☆134Updated 3 weeks ago
• iantbutler01 / rwkv-raven-qlora-4bit-instruct
  A finetuning pipeline for instruct tuning Raven 14bn using QLORA 4bit and the Ditty finetuning library
  ☆28Updated last year
• turboderp-org / exllamav3
  An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
  ☆436Updated this week
• likelovewant / ROCmLibs-for-gfx1103-AMD780M-APU
  ROCm Library Files for gfx1103 and update with others arches based on AMD GPUs for use in Windows.
  ☆549Updated 5 months ago
• l4rz / running-nvidia-sxm-gpus-in-consumer-pcs
  Running SXM2/SXM3/SXM4 NVidia data center GPUs in consumer PCs
  ☆115Updated 2 years ago
• neromous / RWKV-Ouroboros
  This project is established for real-time training of the RWKV model.
  ☆49Updated last year
• nkypy / candle-rwkv
  RWKV models and examples powered by candle.
  ☆18Updated 4 months ago
• OpenMOSE / RWKV-LM-RLHF
  Reinforcement Learning Toolkit for RWKV.(v6,v7,ARWKV) Distillation,SFT,RLHF(DPO,ORPO), infinite context training, Aligning. Exploring the…
  ☆47Updated 2 weeks ago