Alternatives and similar repositories for cubestat

Users that are interested in cubestat are comparing it to the libraries listed below

• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆66Updated last year
• jackcook / predictive-spy
  Spying on Apple’s new predictive text model
  ☆136Updated last year
• LucasSte / MLX-vs-Pytorch
  Benchmarks comparing PyTorch and MLX on Apple Silicon GPUs
  ☆88Updated last year
• zhuzilin / faster-nougat
  Implementation of nougat that focuses on processing pdf locally.
  ☆81Updated 7 months ago
• Artefact2 / llm-eval
  A super simple web interface to perform blind tests on LLM outputs.
  ☆28Updated last year
• kolinko / effort
  An implementation of bucketMul LLM inference
  ☆223Updated last year
• antirez / gguf-tools
  GGUF implementation in C as a library and a tools CLI program
  ☆284Updated this week
• mobiusml / aana_sdk
  Aana SDK is a powerful framework for building AI enabled multimodal applications.
  ☆52Updated last week
• philipp-eisen / modal-mcp-toolbox
  A collection of tools for your LLMs that run on Modal
  ☆22Updated 6 months ago
• fixie-ai / ai-benchmarks
  Benchmarking suite for popular AI APIs
  ☆88Updated 6 months ago
• ScalingIntelligence / tokasaurus
  ☆407Updated last week
• jbarrow / tinyhnsw
  build your own vector database -- the littlest hnsw
  ☆62Updated 7 months ago
• kir-gadjello / zipslicer
  A library for incremental loading of large PyTorch checkpoints
  ☆56Updated 2 years ago
• Michaelvll / llm-ie-benchmarks
  A collection of reproducible inference engine benchmarks
  ☆32Updated 4 months ago
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆221Updated last year
• antirez / LLM-FTC-sampling
  First token cutoff sampling inference example
  ☆31Updated last year
• ivanfioravanti / autogram
  Grammar checker with a keyboard shortcut for Ollama and Apple MLX with Automator on macOS.
  ☆82Updated last year
• huggingface / xet-core
  xet client tech, used in huggingface_hub
  ☆183Updated this week
• ml-explore / mlx-c
  C API for MLX
  ☆125Updated last month
• taylorai / mlx_embedding_models
  run embeddings in MLX
  ☆91Updated 11 months ago
• simonw / llm-cluster
  LLM plugin for clustering embeddings
  ☆81Updated last year
• simonw / docs-for-llms
  Concatenated documentation for use with LLMs
  ☆43Updated this week
• simonw / llm-anyscale-endpoints
  LLM plugin for models hosted by Anyscale Endpoints
  ☆35Updated last year
• apple / ml-recurrent-drafter
  ☆217Updated 7 months ago
• google / minja
  A minimalistic C++ Jinja templating engine for LLM chat templates
  ☆170Updated 3 weeks ago
• sgl-project / sgl-project.github.io
  This is the documentation repository for SGLang. It is auto-generated from https://github.com/sgl-project/sglang/tree/main/docs.
  ☆72Updated this week
• simonw / llm-mistral
  LLM plugin providing access to Mistral models using the Mistral API
  ☆196Updated last month
• fabiocannizzo / FastBinarySearch
  Fast and vectorizable algorithms for searching in a vector of sorted floating point numbers
  ☆146Updated 8 months ago
• Yuyz0112 / relia
  Find the Best LLM for Your Needs through E2E Testing
  ☆81Updated last year
• maxkrieger / spaceshifter
  Finetune your embeddings in-browser
  ☆33Updated last year