okuvshynov / cubestatLinks
Horizon chart for CPU/GPU/Neural Engine utilization monitoring. Supports Apple M1-M4, Nvidia GPUs, AMD GPUs
☆26Updated 3 months ago
Alternatives and similar repositories for cubestat
Users that are interested in cubestat are comparing it to the libraries listed below
Sorting:
- Transformer GPU VRAM estimator☆66Updated last year
- Benchmarks comparing PyTorch and MLX on Apple Silicon GPUs☆89Updated last year
- GGUF implementation in C as a library and a tools CLI program☆294Updated 2 months ago
- Spying on Apple’s new predictive text model☆134Updated last year
- ☆20Updated last month
- 1.58 Bit LLM on Apple Silicon using MLX☆225Updated last year
- An implementation of bucketMul LLM inference☆223Updated last year
- C API for MLX☆150Updated last month
- A minimalistic C++ Jinja templating engine for LLM chat templates☆197Updated last month
- GPU Environment Management for Visual Studio Code☆39Updated 2 years ago
- A super simple web interface to perform blind tests on LLM outputs.☆29Updated last year
- Implementation of nougat that focuses on processing pdf locally.☆83Updated 10 months ago
- Embedding models from Jina AI☆65Updated last year
- A library for incremental loading of large PyTorch checkpoints☆56Updated 2 years ago
- Test server code for Phi-2 model. support OpenAI API spec☆18Updated last year
- Run models distributed as GGUF files using LLM☆79Updated 11 months ago
- A collection of reproducible inference engine benchmarks☆37Updated 6 months ago
- A collection of tools for your LLMs that run on Modal☆22Updated 8 months ago
- xet client tech, used in huggingface_hub☆316Updated last week
- Resources regarding evML (edge verified machine learning)☆19Updated 10 months ago
- LLM inference in C/C++☆103Updated last week
- KAN (Kolmogorov–Arnold Networks) in the MLX framework for Apple Silicon☆30Updated 5 months ago
- LLM plugin for clustering embeddings☆82Updated last year
- Concatenated documentation for use with LLMs☆47Updated last week
- ☆198Updated 6 months ago
- Grammar checker with a keyboard shortcut for Ollama and Apple MLX with Automator on macOS.☆82Updated last year
- Web Interface for Vision Language Models Including InternVLM2☆25Updated last year
- ☆453Updated 3 weeks ago
- GPU prices aggregator for cloud providers☆43Updated last week
- An HTTP serving framework by Banana☆101Updated last year