philpax / ggml

Related projects ⓘ

Alternatives and complementary repositories for ggml

• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆88Updated this week
• AlpinDale / QuIP-for-Llama
  Code for paper: "QuIP: 2-Bit Quantization of Large Language Models With Guarantees" adapted for Llama models
  ☆36Updated last year
• lachlansneff / sparsellama
  ☆40Updated last year
• wozeparrot / tinyrwkv
  tinygrad port of the RWKV large language model.
  ☆43Updated 4 months ago
• OpenGVLab / EfficientQAT
  EfficientQAT: Efficient Quantization-Aware Training for Large Language Models
  ☆222Updated last month
• catid / bitnet_cpu
  Experiments with BitNet inference on CPU
  ☆50Updated 7 months ago
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆86Updated this week
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆134Updated 6 months ago
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆51Updated 8 months ago
• ajtejankar / mixtral-vis-moe
  Visualize expert firing frequencies across sentences in the Mixtral MoE model
  ☆17Updated 10 months ago
• facebookresearch / dual-system-for-visual-language-reasoning
  Github repo for Peifeng's internship project
  ☆12Updated last year
• chu-tianxiang / QuIP-for-all
  QuIP quantization
  ☆46Updated 7 months ago
• cwhy / rwkv-decon
  Trying to deconstruct RWKV in understandable terms
  ☆14Updated last year
• antirez / LLM-FTC-sampling
  First token cutoff sampling inference example
  ☆28Updated 9 months ago
• groq / groqflow
  GroqFlow provides an automated tool flow for compiling machine learning and linear algebra workloads into Groq programs and executing tho…
  ☆99Updated last week
• samuel-vitorino / lm.rs-webui
  Light WebUI for lm.rs
  ☆21Updated 3 weeks ago
• NolanoOrg / llama-int4-quant
  ☆26Updated last year
• Artefact2 / llm-eval
  A super simple web interface to perform blind tests on LLM outputs.
  ☆26Updated 8 months ago
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆98Updated 10 months ago
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆69Updated 9 months ago
• mistralai / vllm-release
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆50Updated 10 months ago
• the-crypt-keeper / ggml-downloader
  Simple, Fast, Parallel Huggingface GGML model downloader written in python
  ☆24Updated last year
• mzbac / mlx-moe
  Scripts to create your own moe models using mlx
  ☆86Updated 8 months ago
• mlc-ai / llm-perf-bench
  ☆114Updated 6 months ago
• Verdagon / Anima
  33B Chinese LLM, DPO QLORA, 100K context, AirLLM 70B inference with single 4GB GPU
  ☆12Updated 6 months ago
• rejunity / tiny-asic-1_58bit-matrix-mul
  Tiny ASIC implementation for "The Era of 1-bit LLMs All Large Language Models are in 1.58 Bits" matrix multiplication unit
  ☆110Updated 6 months ago
• NolanoOrg / SpectraSuite
  ☆43Updated 3 months ago
• teknium1 / LLM-Logbook
  Public reports detailing responses to sets of prompts by Large Language Models.
  ☆25Updated last year
• crashr / gppm
  GPU Power and Performance Manager
  ☆46Updated 3 weeks ago