Alternatives and similar repositories for ggml

Users that are interested in ggml are comparing it to the libraries listed below

• samuel-vitorino / lm.rs-webui
  Light WebUI for lm.rs
  ☆23Updated 7 months ago
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆86Updated this week
• groq / groqflow
  GroqFlow provides an automated tool flow for compiling machine learning and linear algebra workloads into Groq programs and executing tho…
  ☆109Updated 2 months ago
• catid / bitnet_cpu
  Experiments with BitNet inference on CPU
  ☆55Updated last year
• Zyphra / zcookbook
  Training hybrid models for dummies.
  ☆21Updated 4 months ago
• ajtejankar / mixtral-vis-moe
  Visualize expert firing frequencies across sentences in the Mixtral MoE model
  ☆17Updated last year
• NolanoOrg / SpectraSuite
  ☆47Updated 10 months ago
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆30Updated 4 months ago
• antirez / LLM-FTC-sampling
  First token cutoff sampling inference example
  ☆30Updated last year
• AlpinDale / QuIP-for-Llama
  Code for paper: "QuIP: 2-Bit Quantization of Large Language Models With Guarantees" adapted for Llama models
  ☆35Updated last year
• huggingface / dedupe_estimator
  Chunk Dedupe Estimation
  ☆14Updated 6 months ago
• philschmid / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆11Updated 7 months ago
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆70Updated last year
• iantbutler01 / ditty
  A library for simplifying fine tuning with multi gpu setups in the Huggingface ecosystem.
  ☆16Updated 6 months ago
• xaedes / llama.cpp
  Port of Facebook's LLaMA model in C/C++
  ☆20Updated last year
• mgerstgrasser / tacheles
  a lightweight, open-source blueprint for building powerful and scalable LLM chat applications
  ☆28Updated 11 months ago
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆100Updated last year
• deepinfra / deepctl
  Command line tool for Deep Infra cloud ML inference service
  ☆30Updated 11 months ago
• Narsil / bloomserver
  ☆39Updated 2 years ago
• Artefact2 / llm-eval
  A super simple web interface to perform blind tests on LLM outputs.
  ☆28Updated last year
• hscspring / llama.np
  Inference Llama/Llama2/Llama3 Modes in NumPy
  ☆20Updated last year
• slashml / awesome-finetuning
  ☆27Updated 8 months ago
• cwhy / rwkv-decon
  Trying to deconstruct RWKV in understandable terms
  ☆14Updated 2 years ago
• Codys12 / airllm
  AirLLM 70B inference with single 4GB GPU
  ☆12Updated 9 months ago
• Verdagon / Anima
  33B Chinese LLM, DPO QLORA, 100K context, AirLLM 70B inference with single 4GB GPU
  ☆13Updated last year
• khoj-ai / knowledge-graph
  A minimal implementation of GraphRAG, designed to quickly prototype whether you're able to get good sense-making out of a large dataset w…
  ☆28Updated 3 months ago
• mzbac / mlx-moe
  Scripts to create your own moe models using mlx
  ☆89Updated last year
• mistralai / vllm-release
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆52Updated last year
• abetlen / ggml-python
  Python bindings for ggml
  ☆140Updated 8 months ago
• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆61Updated last year