Alternatives and similar repositories for holodeck:

Users that are interested in holodeck are comparing it to the libraries listed below

• go-skynet / go-ggml-transformers.cpp
  Binding to transformers in ggml
  ☆60Updated this week
• tensorchord / ai-infra-statistics
  This repository contains statistics about the AI Infrastructure products.
  ☆18Updated 3 weeks ago
• antirez / LLM-FTC-sampling
  First token cutoff sampling inference example
  ☆29Updated last year
• tensorchord / llmspec
  OpenAI compatible API for open source LLMs
  ☆15Updated last year
• haormj / llama2.go
  Inference Llama 2 in one file of pure go
  ☆16Updated last year
• NVIDIA / k8s-operator-libs
  A collection of useful Go libraries to ease the development of NVIDIA Operators for GPU/NIC management.
  ☆23Updated last week
• vast-ai / vast-pyworker
  ☆9Updated last month
• kubevela / prism
  API Extensions for core KubeVela.
  ☆12Updated last month
• google-deepmind / multiscope
  Real-time visualisation
  ☆16Updated last week
• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆19Updated 3 months ago
• NVIDIA / k8s-driver-manager
  The NVIDIA Driver Manager is a Kubernetes component which assist in seamless upgrades of NVIDIA Driver on each node of the cluster.
  ☆34Updated last week
• cwhy / rwkv-decon
  Trying to deconstruct RWKV in understandable terms
  ☆14Updated last year
• ARM-software / golang-utils
  Helpers and utilities for Golang in order to do actions not available in the standard library.
  ☆33Updated this week
• saracen / llama2.go
  Inference Llama 2 in Go
  ☆39Updated last year
• tensorchord / envd-server
  Backend server for envd
  ☆20Updated last year
• replicate / go
  Repository for go shared libraries (for now).
  ☆11Updated this week
• tairov / lamatune
  LLama implementations benchmarking framework
  ☆12Updated last year
• run-ai / vscode-genv
  GPU Environment Management for Visual Studio Code
  ☆37Updated last year
• gptscript-ai / gptparse
  Document parser for RAG
  ☆22Updated 4 months ago
• kyegomez / Exa
  Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…
  ☆25Updated 4 months ago
• TextGeneratorio / text-generator.io
  Run Vision LLMs, TTS and STT APIs. Website and API for https://text-generator.io
  ☆32Updated last month
• NVIDIA / go-nvlib
  A collection of useful Go libraries for use with NVIDIA GPU management tools
  ☆35Updated last week
• cognitivecomputations / runpod-vllm
  ☆15Updated last year
• iantbutler01 / ditty
  A library for simplifying fine tuning with multi gpu setups in the Huggingface ecosystem.
  ☆16Updated 4 months ago
• evisdrenova / gotorch
  A barebones go implementation of pytorch
  ☆24Updated 7 months ago
• PrimeIntellect-ai / prime-cli
  The Prime Intellect CLI provides a powerful command-line interface for managing GPU resources across various providers
  ☆16Updated 3 weeks ago