okuvshynov / cubestatLinks
Horizon chart for CPU/GPU/Neural Engine utilization monitoring. Supports Apple M1-M4, Nvidia GPUs, AMD GPUs
☆26Updated last month
Alternatives and similar repositories for cubestat
Users that are interested in cubestat are comparing it to the libraries listed below
Sorting:
- Spying on Apple’s new predictive text model☆135Updated 2 years ago
- Transformer GPU VRAM estimator☆67Updated last year
- Benchmarks comparing PyTorch and MLX on Apple Silicon GPUs☆93Updated last week
- ☆23Updated 3 months ago
- GGUF implementation in C as a library and a tools CLI program☆301Updated 5 months ago
- A super simple web interface to perform blind tests on LLM outputs.☆29Updated last year
- An implementation of bucketMul LLM inference☆224Updated last year
- LLM plugin for clustering embeddings☆82Updated last year
- Finetune your embeddings in-browser☆34Updated last year
- build your own vector database -- the littlest hnsw☆67Updated last year
- C API for MLX☆170Updated 3 weeks ago
- Automatically extract executable programs from pruned mechanistic circuits, extending OpenAI's Sparse Circuits☆60Updated 2 months ago
- A library for incremental loading of large PyTorch checkpoints☆56Updated 2 years ago
- 1.58 Bit LLM on Apple Silicon using MLX☆240Updated last year
- Aana SDK is a powerful framework for building AI enabled multimodal applications.☆55Updated 5 months ago
- First token cutoff sampling inference example☆30Updated 2 years ago
- Implementation of nougat that focuses on processing pdf locally.☆84Updated last year
- GPU Environment Management for Visual Studio Code☆39Updated 2 years ago
- GPU prices aggregator for cloud providers☆45Updated last month
- run embeddings in MLX☆97Updated last year
- Run models distributed as GGUF files using LLM☆83Updated last year
- KAN (Kolmogorov–Arnold Networks) in the MLX framework for Apple Silicon☆31Updated 7 months ago
- xet client tech, used in huggingface_hub☆393Updated last week
- A minimalistic C++ Jinja templating engine for LLM chat templates☆202Updated 4 months ago
- Simple high-throughput inference library☆155Updated 8 months ago
- LLM plugin for models hosted by Anyscale Endpoints☆35Updated last year
- Smart proxy for LLM APIs that enables model-specific parameter control, automatic mode switching (like Qwen3's /think and /no_think), and…☆50Updated 8 months ago
- LLM plugin providing access to Mistral models using the Mistral API☆206Updated 6 months ago
- Grammar checker with a keyboard shortcut for Ollama and Apple MLX with Automator on macOS.☆82Updated last year
- A fast minimalistic implementation of guided generation on Apple Silicon using Outlines and MLX☆59Updated last year