Alternatives and similar repositories for AMD-LLM

Users that are interested in AMD-LLM are comparing it to the libraries listed below

• slashml / amd_inference
  Docker-based inference engine for AMD GPUs
  ☆231Updated 9 months ago
• Foreseerr / TScale
  ☆196Updated 3 months ago
• moonshine-ai / qc_npu_benchmark
  Code sample showing how to run and benchmark models on Qualcomm's Window PCs
  ☆100Updated 10 months ago
• anordin95 / run-llama-locally
  Run and explore Llama models locally with minimal dependencies on CPU
  ☆191Updated 9 months ago
• trevorpogue / algebraic-nnhw
  Algebraic enhancements for GEMM & AI accelerators
  ☆278Updated 5 months ago
• robjinman / richard
  Richard is gaining power
  ☆196Updated last month
• ross39 / new_bloom_filter_repo
  This repo contains a new way to use bloom filters to do lossless video compression
  ☆247Updated 2 months ago
• dipampaul17 / KVSplit
  Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit …
  ☆356Updated 2 months ago
• rodlaf / BinaryGPUIndex
  A GPU Accelerated Binary Vector Store
  ☆47Updated 5 months ago
• mlecauchois / micrograd-cuda
  ☆249Updated last year
• lights0123 / hipscript
  Online compiler for HIP and NVIDIA® CUDA® code to WebGPU
  ☆190Updated 6 months ago
• xetdata / onnx-models
  A copy of ONNX models, datasets, and code all in one GitHub repository. Follow the README to learn more.
  ☆105Updated last year
• joennlae / tensorli
  Absolute minimalistic implementation of a GPT-like transformer using only numpy (<650 lines).
  ☆253Updated last year
• a1k0n / a1gpt
  throwaway GPT inference
  ☆140Updated last year
• brianmg / voynich-nlp-analysis
  ☆124Updated 2 months ago
• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆221Updated last year
• Const-me / Cgml
  GPU-targeted vendor-agnostic AI library for Windows, and Mistral model implementation.
  ☆58Updated last year
• umuthopeyildirim / DOOM-Mistral
  Mistral7B playing DOOM
  ☆133Updated last year
• mikex86 / LibreCuda
  ☆1,045Updated 2 months ago
• neuroxhq / helm-chart-neurox-control
  Neurox control helm chart details
  ☆30Updated 3 months ago
• valine / training-hot-swap
  Pytorch script hot swap: Change code without unloading your LLM from VRAM
  ☆126Updated 3 months ago
• adenta / fire_red_agent
  ☆164Updated 4 months ago
• Dicklesworthstone / bakery_algorithm
  Lamport's Bakery Algorithm Demonstrated in Python
  ☆96Updated last year
• mikepapadim / llama-shepherd-cli
  A CLI to manage install and configure llama inference implemenation in multiple languages
  ☆67Updated last year
• M4THYOU / TokenDagger
  High-Performance Implementation of OpenAI's TikToken.
  ☆445Updated last month
• Tsadoq / ErisForge
  Dead Simple LLM Abliteration
  ☆230Updated 5 months ago
• carsonpo / haystackdb
  ☆163Updated last year
• nirw4nna / dsc
  Tensor library & inference framework for machine learning
  ☆106Updated 3 weeks ago
• nyxpsi / nyxpsi
  WIP: Next-gen network protocol for reliable data transfer in lossy environments. Outperforms TCP/UDP in high packet loss scenarios.
  ☆310Updated 10 months ago
• cjdrake / seqlogic
  Sequential Logic
  ☆111Updated this week