Alternatives and similar repositories for cubestat

Users that are interested in cubestat are comparing it to the libraries listed below

• LucasSte / MLX-vs-Pytorch
  Benchmarks comparing PyTorch and MLX on Apple Silicon GPUs
  ☆92Updated last year
• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆67Updated last year
• Artefact2 / llm-eval
  A super simple web interface to perform blind tests on LLM outputs.
  ☆29Updated last year
• dstackai / gpuhunt
  GPU prices aggregator for cloud providers
  ☆45Updated last week
• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆223Updated last year
• jackcook / predictive-spy
  Spying on Apple’s new predictive text model
  ☆134Updated last year
• ml-explore / mlx-c
  C API for MLX
  ☆158Updated this week
• simonw / llm-gguf
  Run models distributed as GGUF files using LLM
  ☆83Updated last year
• dicroce / hnsw
  Heirarchical Navigable Small Worlds
  ☆101Updated 5 months ago
• antirez / LLM-FTC-sampling
  First token cutoff sampling inference example
  ☆30Updated last year
• simonw / llm-cluster
  LLM plugin for clustering embeddings
  ☆82Updated last year
• FL33TW00D / dots.ocr.ne
  ☆21Updated 3 months ago
• antirez / gguf-tools
  GGUF implementation in C as a library and a tools CLI program
  ☆297Updated 4 months ago
• philipp-eisen / modal-mcp-toolbox
  A collection of tools for your LLMs that run on Modal
  ☆22Updated 10 months ago
• kir-gadjello / zipslicer
  A library for incremental loading of large PyTorch checkpoints
  ☆56Updated 2 years ago
• google / minja
  A minimalistic C++ Jinja templating engine for LLM chat templates
  ☆202Updated 3 months ago
• cg123 / rathe
  Tools for formatting large language model prompts.
  ☆13Updated 2 years ago
• jbarrow / tinyhnsw
  build your own vector database -- the littlest hnsw
  ☆67Updated last year
• Foreseerr / TScale
  ☆199Updated 8 months ago
• Michaelvll / llm-ie-benchmarks
  A collection of reproducible inference engine benchmarks
  ☆38Updated 8 months ago
• ivanfioravanti / autogram
  Grammar checker with a keyboard shortcut for Ollama and Apple MLX with Automator on macOS.
  ☆82Updated last year
• Goekdeniz-Guelmez / mlx-kan
  KAN (Kolmogorov–Arnold Networks) in the MLX framework for Apple Silicon
  ☆31Updated 6 months ago
• harperreed / mlx_clip
  A simple package to use CLIP on apple silicon using the MLX libraries from Apple
  ☆74Updated last year
• zhuzilin / faster-nougat
  Implementation of nougat that focuses on processing pdf locally.
  ☆83Updated 11 months ago
• vectordb-io / vectordb
  Vectordb is a database software used in AI service, supporting operations on vector, graph, session, kv, etc. It can work together with t…
  ☆47Updated 4 months ago
• simonw / llm-anyscale-endpoints
  LLM plugin for models hosted by Anyscale Endpoints
  ☆35Updated last year
• dropbox / aana_sdk
  Aana SDK is a powerful framework for building AI enabled multimodal applications.
  ☆55Updated 4 months ago
• simonw / llm-embed-jina
  Embedding models from Jina AI
  ☆65Updated last year
• simonw / llm-mistral
  LLM plugin providing access to Mistral models using the Mistral API
  ☆205Updated 5 months ago
• irthomasthomas / llm-cerebras
  llm plugin for Cerebras fast inference API
  ☆34Updated 5 months ago