Alternatives and similar repositories for cubestat:

Users that are interested in cubestat are comparing it to the libraries listed below

• Artefact2 / llm-eval
  A super simple web interface to perform blind tests on LLM outputs.
  ☆28Updated last year
• antirez / LLM-FTC-sampling
  First token cutoff sampling inference example
  ☆29Updated last year
• maxkrieger / spaceshifter
  Finetune your embeddings in-browser
  ☆32Updated last year
• LucasSte / MLX-vs-Pytorch
  Benchmarks comparing PyTorch and MLX on Apple Silicon GPUs
  ☆78Updated 9 months ago
• PrimeIntellect-ai / prime-cli
  The Prime Intellect CLI provides a powerful command-line interface for managing GPU resources across various providers
  ☆18Updated 2 weeks ago
• morgangiraud / text-to-sql-proto
  A text-to-SQL prototype on the northwind sqlite dataset
  ☆12Updated 6 months ago
• irthomasthomas / llm-cerebras
  llm plugin for Cerebras fast inference API
  ☆24Updated last month
• google / minja
  A minimalistic C++ Jinja templating engine for LLM chat templates
  ☆132Updated last week
• ajtejankar / mixtral-vis-moe
  Visualize expert firing frequencies across sentences in the Mixtral MoE model
  ☆17Updated last year
• cognitivecomputations / runpod-vllm
  ☆15Updated last year
• exo-explore / evML
  Resources regarding evML (edge verified machine learning)
  ☆16Updated 3 months ago
• firstbatchxyz / function-calling-eval
  The DPAB-α Benchmark
  ☆20Updated 3 months ago
• character-ai / MuKoe
  ☆53Updated 11 months ago
• Zyphra / zcookbook
  Training hybrid models for dummies.
  ☆20Updated 3 months ago
• simonw / docs-for-llms
  Concatenated documentation for use with LLMs
  ☆29Updated this week
• kir-gadjello / zipslicer
  A library for incremental loading of large PyTorch checkpoints
  ☆56Updated 2 years ago
• modal-labs / cadre
  🛠 Self-hosted, fast, and consistent remote configuration for apps.
  ☆15Updated 2 years ago
• sushrut141 / vamana
  Exploration of Vector database Index for fast approximate nearest neighbour search.
  ☆22Updated 8 months ago
• ivanfioravanti / lmstudio_hf
  A command-line utility to manage MLX models between your Hugging Face cache and LM Studio.
  ☆33Updated 2 months ago
• g-aggarwal / mlx-hub
  A python command-line tool to download & manage MLX AI models from Hugging Face.
  ☆17Updated 7 months ago
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆76Updated 4 months ago
• simonw / llm-mlx-llama
  Run Llama 2 using MLX on macOS
  ☆34Updated last year
• ryao / llama3.c
  A fork of llama3.c used to do some R&D on inferencing
  ☆20Updated 4 months ago
• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆59Updated last year
• abhisheknair10 / llama3.cu
  Lightweight Llama 3 8B Inference Engine in CUDA C
  ☆47Updated last month
• hrishioa / tough-llm-tests
  Some tough questions to test new models.
  ☆27Updated last year
• zhuzilin / faster-nougat
  Implementation of nougat that focuses on processing pdf locally.
  ☆81Updated 3 months ago
• N8python / mlx-gpt
  A simple MLX implementation for pretraining LLMs on Apple Silicon.
  ☆28Updated 3 months ago
• deepinfra / deepctl
  Command line tool for Deep Infra cloud ML inference service
  ☆30Updated 10 months ago
• rabilrbl / llamafile-builder
  A simple github actions script to build a llamafile and uploads to huggingface
  ☆14Updated last year