Alternatives and similar repositories for gpuhunt

Users that are interested in gpuhunt are comparing it to the libraries listed below

• DeployQL / LintDB
  Vector Database with support for late interaction and token level embeddings.
  ☆54Updated 6 months ago
• cfahlgren1 / observers
  A Lightweight Library for AI Observability
  ☆253Updated 10 months ago
• anyscale / llm-router
  Tutorial for building LLM router
  ☆241Updated last year
• cohere-ai / quick-start-connectors
  This open-source repository offers reference code for integrating workplace datastores with Cohere's LLMs, enabling developers and busine…
  ☆155Updated last year
• tensorwavecloud / ScalarLM
  ScalarLM - a unified training and inference stack
  ☆94Updated last month
• simonw / llm-embed-jina
  Embedding models from Jina AI
  ☆65Updated last year
• autonomi-ai / nos
  ⚡️ A fast and flexible PyTorch inference server that runs locally, on any cloud or AI HW.
  ☆146Updated last year
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆163Updated last month
• parea-ai / parea-sdk-py
  Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)
  ☆82Updated 10 months ago
• substratusai / vllm-docker
  ☆67Updated 9 months ago
• philipp-eisen / modal-mcp-toolbox
  A collection of tools for your LLMs that run on Modal
  ☆22Updated 10 months ago
• Preemo-Inc / text-generation-inference
  ☆198Updated last year
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆69Updated last month
• neoxelox / dspy-inspector
  DSPy program/pipeline inspector widget for Jupyter/VSCode Notebooks.
  ☆43Updated last year
• masci / banks
  LLM prompt language based on Jinja. Banks provides tools and functions to build prompts text and chat messages from generic blueprints. I…
  ☆120Updated 3 weeks ago
• jina-ai / correlations
  Simple UI for debugging correlations of text embeddings
  ☆306Updated 7 months ago
• deepset-ai / haystack-core-integrations
  Additional packages (components, document stores and the likes) to extend the capabilities of Haystack
  ☆177Updated this week
• dropbox / aana_sdk
  Aana SDK is a powerful framework for building AI enabled multimodal applications.
  ☆55Updated 4 months ago
• mozilla-ai / structured-qa
  Blueprint by Mozilla.ai for answering questions about structured documents
  ☆37Updated 9 months ago
• log10-io / log10
  Python client library for improving your LLM app accuracy
  ☆97Updated 11 months ago
• virevolai / logos-shift-client
  Replace expensive LLM calls with finetunes automatically
  ☆66Updated last year
• enjalot / latent-data-modal
  Using modal.com to process FineWeb-edu data
  ☆20Updated 9 months ago
• michaelfeil / embed
  A stable, fast and easy-to-use inference library with a focus on a sync-to-async API
  ☆47Updated last year
• jlscheerer / xtr-warp
  XTR/WARP (SIGIR'25) is an extremely fast and accurate retrieval engine based on Stanford's ColBERTv2/PLAID and Google DeepMind's XTR.
  ☆175Updated 8 months ago
• Portkey-AI / portkey-python-sdk
  Build reliable, secure, and production-ready AI apps easily.
  ☆97Updated last month
• AnswerDotAI / web2md
  Convert a web page to markdown
  ☆80Updated last year
• pulzeai-oss / knn-router
  ☆114Updated last year
• langfuse / oss-llmops-stack
  Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-…
  ☆129Updated 10 months ago
• runpod-workers / worker-sglang
  SGLang is fast serving framework for large language models and vision language models.
  ☆31Updated last month
• weaviate / structured-rag
  Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
  ☆115Updated 9 months ago