okuvshynov / cubestatLinks
Horizon chart for CPU/GPU/Neural Engine utilization monitoring. Supports Apple M1-M4, Nvidia GPUs, AMD GPUs
☆26Updated 2 weeks ago
Alternatives and similar repositories for cubestat
Users that are interested in cubestat are comparing it to the libraries listed below
Sorting:
- A super simple web interface to perform blind tests on LLM outputs.☆28Updated last year
- Benchmarks comparing PyTorch and MLX on Apple Silicon GPUs☆88Updated last year
- Transformer GPU VRAM estimator☆66Updated last year
- GGUF implementation in C as a library and a tools CLI program☆280Updated 7 months ago
- Spying on Apple’s new predictive text model☆135Updated last year
- 1.58 Bit LLM on Apple Silicon using MLX☆217Updated last year
- An implementation of bucketMul LLM inference☆221Updated last year
- Implementation of nougat that focuses on processing pdf locally.☆81Updated 6 months ago
- Finetune your embeddings in-browser☆33Updated last year
- A collection of tools for your LLMs that run on Modal☆21Updated 5 months ago
- A library for incremental loading of large PyTorch checkpoints☆56Updated 2 years ago
- Grammar checker with a keyboard shortcut for Ollama and Apple MLX with Automator on macOS.☆82Updated last year
- A simple package to use CLIP on apple silicon using the MLX libraries from Apple☆72Updated last year
- LLM plugin for clustering embeddings☆80Updated last year
- Embedding models from Jina AI☆64Updated last year
- run embeddings in MLX☆90Updated 10 months ago
- C API for MLX☆121Updated last month
- LLM plugin providing access to Mistral models using the Mistral API☆196Updated 3 weeks ago
- Benchmarking suite for popular AI APIs☆87Updated 6 months ago
- The Prime Intellect CLI provides a powerful command-line interface for managing GPU resources across various providers☆30Updated this week
- Vectordb is a database software used in AI service, supporting operations on vector, graph, session, kv, etc. It can work together with t…☆46Updated last week
- ☆112Updated last year
- An HTTP serving framework by Banana☆102Updated last year
- GroqFlow provides an automated tool flow for compiling machine learning and linear algebra workloads into Groq programs and executing tho…☆111Updated last week
- Some tough questions to test new models.☆28Updated last year
- Find the Best LLM for Your Needs through E2E Testing☆81Updated last year
- ☆129Updated 2 years ago
- Simple high-throughput inference library☆125Updated 2 months ago
- Run models distributed as GGUF files using LLM☆72Updated 8 months ago
- Tiny inference-only implementation of LLaMA☆93Updated last year