Alternatives and similar repositories for AMD-LLM

Users that are interested in AMD-LLM are comparing it to the libraries listed below

• Foreseerr / TScale
  ☆192Updated 3 weeks ago
• usefulsensors / qc_npu_benchmark
  Code sample showing how to run and benchmark models on Qualcomm's Window PCs
  ☆97Updated 8 months ago
• slashml / amd_inference
  Docker-based inference engine for AMD GPUs
  ☆230Updated 7 months ago
• anordin95 / run-llama-locally
  Run and explore Llama models locally with minimal dependencies on CPU
  ☆189Updated 7 months ago
• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆217Updated 11 months ago
• trevorpogue / algebraic-nnhw
  Algebraic enhancements for GEMM & AI accelerators
  ☆276Updated 3 months ago
• lights0123 / hipscript
  Online compiler for HIP and NVIDIA® CUDA® code to WebGPU
  ☆150Updated 4 months ago
• dipampaul17 / KVSplit
  Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit …
  ☆350Updated 2 weeks ago
• carsonpo / haystackdb
  ☆163Updated last year
• joennlae / tensorli
  Absolute minimalistic implementation of a GPT-like transformer using only numpy (<650 lines).
  ☆251Updated last year
• xetdata / onnx-models
  A copy of ONNX models, datasets, and code all in one GitHub repository. Follow the README to learn more.
  ☆105Updated last year
• Tsadoq / ErisForge
  Dead Simple LLM Abliteration
  ☆218Updated 3 months ago
• rentruewang / bocoel
  Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) that's 10 times faster with just a few l…
  ☆284Updated last week
• valine / training-hot-swap
  Pytorch script hot swap: Change code without unloading your LLM from VRAM
  ☆126Updated last month
• mlecauchois / micrograd-cuda
  ☆243Updated last year
• brianmg / voynich-nlp-analysis
  ☆121Updated last week
• ross39 / new_bloom_filter_repo
  ☆228Updated this week
• robjinman / richard
  Richard is gaining power
  ☆187Updated 6 months ago
• mojyack / shortwire
  minimal yet working VPN daemon for Linux
  ☆106Updated last month
• distantmagic / paddler
  Stateful load balancer custom-tailored for llama.cpp 🏓🦙
  ☆764Updated last week
• dicroce / hnsw
  Heirarchical Navigable Small Worlds
  ☆96Updated last month
• AMD-AIG-AIMA / Instella
  Fully Open Language Models with Stellar Performance
  ☆228Updated 3 weeks ago
• DiscoGrad / DiscoGrad
  DiscoGrad - automatically differentiate across conditional branches in C++ programs
  ☆202Updated 8 months ago
• Z-Gort / Reservoirs-Lab
  ☆279Updated 5 months ago
• andyk / recursive_llm
  Implement recursion using English as the programming language and an LLM as the runtime.
  ☆235Updated 2 years ago
• babycommando / neuralgraffiti
  Live-bending a foundation model’s output at neural network level.
  ☆254Updated last month
• libriscv / drogon-sandbox
  ☆131Updated last month
• facebookresearch / searchformer
  Official codebase for the paper "Beyond A* Better Planning with Transformers via Search Dynamics Bootstrapping".
  ☆367Updated 11 months ago
• adenta / fire_red_agent
  ☆159Updated 2 months ago
• IST-DASLab / QUIK
  Repository for the QUIK project, enabling the use of 4bit kernels for generative inference - EMNLP 2024
  ☆182Updated last year