Alternatives and similar repositories for kompute

Users that are interested in kompute are comparing it to the libraries listed below

• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆191Updated last year
• google / minja
  A minimalistic C++ Jinja templating engine for LLM chat templates
  ☆187Updated 2 weeks ago
• PABannier / biogpt.cpp
  Port of Microsoft's BioGPT in C/C++ using ggml
  ☆85Updated last year
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆55Updated last year
• BlinkDL / fast.c
  Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.
  ☆73Updated 8 months ago
• abetlen / ggml-python
  Python bindings for ggml
  ☆146Updated last year
• RobinQu / instinct.cpp
  instinct.cpp provides ready to use alternatives to OpenAI Assistant API and built-in utilities for developing AI Agent applications (RAG,…
  ☆52Updated last year
• ggerganov / stable-diffusion.cpp
  Stable Diffusion in pure C/C++
  ☆60Updated 2 years ago
• pranavjad / tinyllama-bitnet
  Train your own small bitnet model
  ☆75Updated 11 months ago
• skeskinen / llama-lite
  Embeddings focused small version of Llama NLP model
  ☆105Updated 2 years ago
• xyzhang626 / embeddings.cpp
  ggml implementation of embedding models including SentenceTransformer and BGE
  ☆59Updated last year
• nomic-ai / llama.cpp
  llama.cpp fork used by GPT4All
  ☆57Updated 7 months ago
• GaoYusong / llm.cpp
  A C++ port of karpathy/llm.c features a tiny torch library while maintaining overall simplicity.
  ☆36Updated last year
• rahuldshetty / starcoder.js
  Web browser version of StarCoder.cpp
  ☆45Updated 2 years ago
• ggml-org / p1
  LLM-based code completion engine
  ☆191Updated 8 months ago
• catid / bitnet_cpu
  Experiments with BitNet inference on CPU
  ☆54Updated last year
• spectral-compute / scale-examples
  ☆64Updated last year
• gf712 / gpt2-cpp
  GPT2 implementation in C++ using Ort
  ☆26Updated 4 years ago
• BlinkDL / nanoRWKV
  RWKV in nanoGPT style
  ☆192Updated last year
• wozeparrot / tinyrwkv
  tinygrad port of the RWKV large language model.
  ☆44Updated 7 months ago
• huggingface / optimum-amd
  AMD related optimizations for transformer models
  ☆90Updated last month
• ngxson / ggml-easy
  Thin wrapper around GGML to make life easier
  ☆39Updated 3 months ago
• chu-tianxiang / llama-cpp-torch
  llama.cpp to PyTorch Converter
  ☆34Updated last year
• ggerganov / bark.cpp
  Port of Suno AI's Bark in C/C++ for fast inference
  ☆52Updated last year
• mmwillet / TTS.cpp
  TTS support with GGML
  ☆180Updated this week
• hscspring / llama.np
  Inference Llama/Llama2/Llama3 Modes in NumPy
  ☆21Updated last year
• lukasVierling / FaceRWKV
  Course Project for COMP4471 on RWKV
  ☆17Updated last year
• balisujohn / tortoise.cpp
  A ggml (C++) re-implementation of tortoise-tts
  ☆189Updated last year
• menloresearch / cortex.tensorrt-llm
  Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU a…
  ☆42Updated last year
• monatis / lmm.cpp
  Inference of Large Multimodal Models in C/C++. LLaVA and others
  ☆48Updated 2 years ago