okuvshynov / cubestatLinks
Horizon chart for CPU/GPU/Neural Engine utilization monitoring. Supports Apple M1-M4, Nvidia GPUs, AMD GPUs
☆26Updated 2 months ago
Alternatives and similar repositories for cubestat
Users that are interested in cubestat are comparing it to the libraries listed below
Sorting:
- Transformer GPU VRAM estimator☆67Updated last year
- Benchmarks comparing PyTorch and MLX on Apple Silicon GPUs☆89Updated last year
- Spying on Apple’s new predictive text model☆134Updated last year
- A super simple web interface to perform blind tests on LLM outputs.☆28Updated last year
- A library for incremental loading of large PyTorch checkpoints☆56Updated 2 years ago
- An implementation of bucketMul LLM inference☆223Updated last year
- LLM plugin for clustering embeddings☆82Updated last year
- Grammar checker with a keyboard shortcut for Ollama and Apple MLX with Automator on macOS.☆82Updated last year
- Embedding models from Jina AI☆65Updated last year
- Finetune your embeddings in-browser☆33Updated last year
- Run models distributed as GGUF files using LLM☆76Updated 10 months ago
- GGUF implementation in C as a library and a tools CLI program☆291Updated last month
- Implementation of nougat that focuses on processing pdf locally.☆83Updated 9 months ago
- LLM plugin providing access to Mistral models using the Mistral API☆196Updated 2 months ago
- build your own vector database -- the littlest hnsw☆65Updated 9 months ago
- LLM plugin for models hosted by Anyscale Endpoints☆35Updated last year
- Simple high-throughput inference library☆146Updated 5 months ago
- Aana SDK is a powerful framework for building AI enabled multimodal applications.☆52Updated last month
- A minimalistic C++ Jinja templating engine for LLM chat templates☆190Updated 3 weeks ago
- An awesome list of AnthropicAI' Claude model☆52Updated 2 years ago
- Resources regarding evML (edge verified machine learning)☆20Updated 9 months ago
- EXO Gym is an open-source Python toolkit that facilitates distributed AI research.☆78Updated last month
- A collection of tools for your LLMs that run on Modal☆22Updated 7 months ago
- Chat Markup Language conversation library☆55Updated last year
- Web Interface for Vision Language Models Including InternVLM2☆23Updated last year
- A simple package to use CLIP on apple silicon using the MLX libraries from Apple☆73Updated last year
- Public reports detailing responses to sets of prompts by Large Language Models.☆31Updated 9 months ago
- xet client tech, used in huggingface_hub☆297Updated last week
- ☆19Updated last year
- ☆112Updated last year