Alternatives and similar repositories for cubestat:

Users that are interested in cubestat are comparing it to the libraries listed below

• Artefact2 / llm-eval
  A super simple web interface to perform blind tests on LLM outputs.
  ☆27Updated 11 months ago
• antirez / LLM-FTC-sampling
  First token cutoff sampling inference example
  ☆29Updated last year
• irthomasthomas / llm-cerebras
  llm plugin for Cerebras fast inference API
  ☆23Updated last month
• LucasSte / MLX-vs-Pytorch
  Benchmarks comparing PyTorch and MLX on Apple Silicon GPUs
  ☆75Updated 7 months ago
• modal-labs / cadre
  🛠 Self-hosted, fast, and consistent remote configuration for apps.
  ☆14Updated 2 years ago
• ajtejankar / mixtral-vis-moe
  Visualize expert firing frequencies across sentences in the Mixtral MoE model
  ☆17Updated last year
• simonw / llm-docs
  LLM plugin providing access to the LLM documentation
  ☆17Updated 2 weeks ago
• andyk / headlong
  A framework for collecting a large human-sourced chain-of-thoughts dataset
  ☆19Updated 7 months ago
• lechmazur / nyt-connections
  Benchmark that evaluates LLMs using 436 NYT Connections puzzles
  ☆35Updated this week
• zhuzilin / faster-nougat
  Implementation of nougat that focuses on processing pdf locally.
  ☆79Updated last month
• maxkrieger / spaceshifter
  Finetune your embeddings in-browser
  ☆32Updated 10 months ago
• kir-gadjello / zipslicer
  A library for incremental loading of large PyTorch checkpoints
  ☆56Updated 2 years ago
• BismuthCloud / asimov
  A Python framework for building AI agent systems with robust task management in the form of a graph execution engine, inference capabilit…
  ☆21Updated last week
• simonw / llm-nomic-api-embed
  Create embeddings for LLM using the Nomic API
  ☆22Updated 3 months ago
• okuvshynov / llama_duo
  asynchronous/distributed speculative evaluation for llama3
  ☆37Updated 6 months ago
• google / minja
  A minimalistic C++ Jinja templating engine for LLM chat templates
  ☆123Updated last week
• sushrut141 / vamana
  Exploration of Vector database Index for fast approximate nearest neighbour search.
  ☆20Updated 7 months ago
• antirez / gguf-tools
  GGUF implementation in C as a library and a tools CLI program
  ☆258Updated last month
• capsuleman / ssd-nvme-database
  Columnar database on SSD NVMe
  ☆13Updated 3 years ago
• ryao / llama3.c
  A fork of llama3.c used to do some R&D on inferencing
  ☆19Updated 2 months ago
• uogbuji / mlx-notes
  Shared personal notes created while working with the Apple MLX machine learning framework
  ☆21Updated 8 months ago
• deepinfra / deepctl
  Command line tool for Deep Infra cloud ML inference service
  ☆29Updated 8 months ago
• character-ai / MuKoe
  ☆52Updated 10 months ago
• lucyknada / detective-needle-llm
  ☆12Updated 5 months ago
• cognitivecomputations / runpod-vllm
  ☆15Updated last year
• enochyearn / MLX_RoBERTa
  Roberta Question Answering using MLX.
  ☆24Updated last year
• abhisheknair10 / llama3.cu
  Lightweight Llama 3 8B Inference Engine in CUDA C
  ☆46Updated 2 weeks ago
• simonw / llm-mlx-llama
  Run Llama 2 using MLX on macOS
  ☆33Updated last year