Alternatives and similar repositories for ggml:

Users that are interested in ggml are comparing it to the libraries listed below

• antirez / LLM-FTC-sampling
  First token cutoff sampling inference example
  ☆30Updated last year
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆86Updated this week
• xaedes / llama.cpp
  Port of Facebook's LLaMA model in C/C++
  ☆20Updated last year
• hscspring / llama.np
  Inference Llama/Llama2/Llama3 Modes in NumPy
  ☆20Updated last year
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆71Updated this week
• AlpinDale / QuIP-for-Llama
  Code for paper: "QuIP: 2-Bit Quantization of Large Language Models With Guarantees" adapted for Llama models
  ☆35Updated last year
• NolanoOrg / SpectraSuite
  ☆46Updated 9 months ago
• catid / bitnet_cpu
  Experiments with BitNet inference on CPU
  ☆53Updated last year
• lucyknada / detective-needle-llm
  ☆12Updated 7 months ago
• philschmid / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆11Updated 7 months ago
• nomic-ai / kompute
  General purpose GPU compute framework built on Vulkan to support 1000s of cross vendor graphics cards (AMD, Qualcomm, NVIDIA & friends). …
  ☆46Updated 2 months ago
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆99Updated last year
• pranavjad / tinyllama-bitnet
  Train your own small bitnet model
  ☆67Updated 6 months ago
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆30Updated 3 months ago
• kyegomez / Exa
  Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…
  ☆26Updated 5 months ago
• leloykun / llama2.cpp
  Inference Llama 2 in one file of pure C++
  ☆83Updated last year
• samuel-vitorino / lm.rs-webui
  Light WebUI for lm.rs
  ☆23Updated 6 months ago
• deepinfra / deepctl
  Command line tool for Deep Infra cloud ML inference service
  ☆30Updated 10 months ago
• huggingface / dedupe_estimator
  Chunk Dedupe Estimation
  ☆14Updated 5 months ago
• rafacelente / bllama
  1.58-bit LLaMa model
  ☆81Updated last year
• serp-ai / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆31Updated 11 months ago
• firstbatchxyz / function-calling-eval
  The DPAB-α Benchmark
  ☆20Updated 3 months ago
• LambdaLabsML / llama
  Inference code for LLaMA models
  ☆42Updated 2 years ago
• alasdairforsythe / capcode
  Lossless normalization of uppercase characters
  ☆11Updated last year
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆44Updated 11 months ago
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆56Updated last year
• Zyphra / zcookbook
  Training hybrid models for dummies.
  ☆20Updated 3 months ago
• jndiogo / sibila
  Extract structured data from local or remote LLM models
  ☆41Updated 10 months ago
• ajtejankar / mixtral-vis-moe
  Visualize expert firing frequencies across sentences in the Mixtral MoE model
  ☆17Updated last year
• intellectronica / battle-of-the-semantics
  GraphRag vs Embeddings
  ☆13Updated 9 months ago