antirez / gguf-tools

Related projects ⓘ

Alternatives and complementary repositories for gguf-tools

• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆178Updated 8 months ago
• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆214Updated 4 months ago
• trzy / llava-cpp-server
  LLaVA server (llama.cpp).
  ☆177Updated last year
• distantmagic / paddler
  Stateful load balancer custom-tailored for llama.cpp
  ☆563Updated this week
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆93Updated this week
• a1k0n / a1gpt
  throwaway GPT inference
  ☆139Updated 5 months ago
• Maknee / minigpt4.cpp
  Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)
  ☆558Updated last year
• abetlen / ggml-python
  Python bindings for ggml
  ☆132Updated 2 months ago
• ggml-org / p1
  LLM-based code completion engine
  ☆175Updated last year
• monatis / clip.cpp
  CLIP inference in plain C/C++ with no extra dependencies
  ☆459Updated 3 months ago
• skeskinen / bert.cpp
  ggml implementation of BERT
  ☆466Updated 8 months ago
• philipturner / metal-flash-attention
  FlashAttention (Metal Port)
  ☆386Updated last month
• togethercomputer / redpajama.cpp
  Extend the original llama.cpp repo to support redpajama model.
  ☆117Updated 2 months ago
• danielgross / ggml-k8s
  Run GGML models with Kubernetes.
  ☆173Updated 11 months ago
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆51Updated 9 months ago
• kayvr / token-hawk
  WebGPU LLM inference tuned by hand
  ☆147Updated last year
• NolanoOrg / cformers
  SoTA Transformers with C-backend for fast inference on your CPU.
  ☆312Updated 11 months ago
• symisc / tiny-dream
  Tiny Dream - An embedded, Header Only, Stable Diffusion C++ implementation
  ☆253Updated last year
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆149Updated 4 months ago
• mlecauchois / micrograd-cuda
  ☆234Updated 8 months ago
• umuthopeyildirim / DOOM-Mistral
  Mistral7B playing DOOM
  ☆122Updated 4 months ago
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆146Updated 6 months ago
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆244Updated 9 months ago
• ptsochantaris / emeltal
  Local ML voice chat using high-end models.
  ☆145Updated this week
• bigcode-project / starcoder.cpp
  C++ implementation for 💫StarCoder
  ☆446Updated last year
• Cerebras / gigaGPT
  a small code base for training large models
  ☆266Updated 3 weeks ago
• Birch-san / mpt-play
  Command-line script for inferencing from models such as MPT-7B-Chat
  ☆102Updated last year
• PABannier / biogpt.cpp
  Port of Microsoft's BioGPT in C/C++ using ggml
  ☆87Updated 9 months ago
• IntrinsicLabsAI / gbnfgen
  TypeScript generator for llama.cpp Grammar directly from TypeScript interfaces
  ☆131Updated 4 months ago
• PABannier / encodec.cpp
  Port of Meta's Encodec in C/C++
  ☆203Updated this week