Alternatives and similar repositories for ggml:

Users that are interested in ggml are comparing it to the libraries listed below

• antirez / LLM-FTC-sampling
  First token cutoff sampling inference example
  ☆29Updated last year
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆87Updated this week
• pranavjad / tinyllama-bitnet
  Train your own small bitnet model
  ☆65Updated 5 months ago
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆67Updated last week
• Artefact2 / llm-eval
  A super simple web interface to perform blind tests on LLM outputs.
  ☆28Updated last year
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆30Updated 2 months ago
• cognitivecomputations / kraken
  ☆66Updated 10 months ago
• catid / bitnet_cpu
  Experiments with BitNet inference on CPU
  ☆53Updated last year
• Antlera / nanoGPT-moe
  Enable moe for nanogpt.
  ☆24Updated last year
• emrgnt-cmplxty / zero-shot-replication
  ☆73Updated last year
• samuel-vitorino / lm.rs-webui
  Light WebUI for lm.rs
  ☆23Updated 5 months ago
• lukasVierling / FaceRWKV
  Course Project for COMP4471 on RWKV
  ☆17Updated last year
• brittlewis12 / autogguf
  Easily convert HuggingFace models to GGUF-format for llama.cpp
  ☆21Updated 8 months ago
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆99Updated last year
• chroma-core / hnswlib
  Chroma's fork of hnswlib - a header-only C++/python library for fast approximate nearest neighbors
  ☆16Updated this week
• deepinfra / deepctl
  Command line tool for Deep Infra cloud ML inference service
  ☆29Updated 9 months ago
• xaedes / llama.cpp
  Port of Facebook's LLaMA model in C/C++
  ☆20Updated last year
• anarchy-ai / llm-speed-benchmark
  Benchmarking tool for assessing LLM models' performance across different hardwares
  ☆16Updated last year
• groq / groqflow
  GroqFlow provides an automated tool flow for compiling machine learning and linear algebra workloads into Groq programs and executing tho…
  ☆108Updated 3 weeks ago
• NolanoOrg / SpectraSuite
  ☆46Updated 8 months ago
• lucyknada / detective-needle-llm
  ☆12Updated 6 months ago
• zhuzilin / faster-nougat
  Implementation of nougat that focuses on processing pdf locally.
  ☆81Updated 2 months ago
• character-ai / MuKoe
  ☆52Updated 11 months ago
• BlinkDL / fast.c
  Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.
  ☆70Updated 2 months ago
• rafacelente / bllama
  1.58-bit LLaMa model
  ☆81Updated 11 months ago
• Contextualist / lone-arena
  Self-hosted LLM chatbot arena, with yourself as the only judge
  ☆38Updated last year
• nomic-ai / kompute
  General purpose GPU compute framework built on Vulkan to support 1000s of cross vendor graphics cards (AMD, Qualcomm, NVIDIA & friends). …
  ☆44Updated last month
• Zyphra / zcookbook
  Training hybrid models for dummies.
  ☆20Updated 2 months ago
• facebookresearch / dual-system-for-visual-language-reasoning
  Github repo for Peifeng's internship project
  ☆14Updated last year
• ajtejankar / mixtral-vis-moe
  Visualize expert firing frequencies across sentences in the Mixtral MoE model
  ☆17Updated last year