Alternatives and similar repositories for holodeck

Users that are interested in holodeck are comparing it to the libraries listed below

• go-skynet / go-ggml-transformers.cpp
  Binding to transformers in ggml
  ☆64Updated last week
• NVIDIA / go-nvlib
  A collection of useful Go libraries for use with NVIDIA GPU management tools
  ☆50Updated 3 weeks ago
• NVIDIA / k8s-operator-libs
  A collection of useful Go libraries to ease the development of NVIDIA Operators for GPU/NIC management.
  ☆28Updated this week
• saracen / llama2.go
  Inference Llama 2 in Go
  ☆39Updated 2 years ago
• coreweave / ml-containers
  ☆44Updated this week
• haormj / llama2.go
  Inference Llama 2 in one file of pure go
  ☆16Updated 2 years ago
• openai / kubernetes
  Production-Grade Container Scheduling and Management
  ☆65Updated last week
• antirez / LLM-FTC-sampling
  First token cutoff sampling inference example
  ☆30Updated 2 years ago
• kubernetes / dynamic-resource-allocation
  ☆43Updated this week
• tensorchord / ai-infra-statistics
  This repository contains statistics about the AI Infrastructure products.
  ☆17Updated 11 months ago
• Intelligent-Internet / II-Commons
  This repository `II-Commons` contains tools for managing text and image datasets, including loading, fetching, and embedding large datase…
  ☆33Updated 6 months ago
• google-deepmind / multiscope
  Real-time visualisation
  ☆21Updated 4 months ago
• gomlx / gopjrt
  Go Wrappers for OpenXLA PJRT
  ☆36Updated last month
• NVIDIA / k8s-driver-manager
  The NVIDIA Driver Manager is a Kubernetes component which assist in seamless upgrades of NVIDIA Driver on each node of the cluster.
  ☆48Updated last week
• 0x9ef / openai-go
  OpenAI GPT-3/3.5/4 API client written in Go
  ☆20Updated 2 years ago
• NVIDIA / nim-anywhere
  Accelerate your Gen AI with NVIDIA NIM and NVIDIA AI Workbench
  ☆202Updated 9 months ago
• NVIDIA / ais-k8s
  Kubernetes Operator, ansible playbooks, and production scripts for large-scale AIStore deployments on Kubernetes.
  ☆124Updated this week
• AI-Hypercomputer / inference-benchmark
  ☆17Updated 7 months ago
• cohere-ai / cohere-go
  Go Library for Accessing the Cohere API
  ☆69Updated last week
• huggingface / candle-cublaslt
  ☆12Updated last year
• opendatahub-io / vllm-tgis-adapter
  vLLM adapter for a TGIS-compatible gRPC server.
  ☆50Updated this week
• tensorchord / deepseek-api-arena
  A benchmarking tool for comparing different LLM API providers' DeepSeek model deployments.
  ☆30Updated 10 months ago
• replicate / pget
  parallel fetch
  ☆144Updated 2 months ago
• moby / sys
  ☆91Updated 5 months ago
• minio / pkg
  Repository to hold all the common packages imported by MinIO projects
  ☆31Updated last week
• matthewrennie / go-llama.cpp
  Go bindings for LLama.cpp
  ☆14Updated 2 years ago
• tensorchord / envd-server
  Backend server for envd
  ☆22Updated 2 years ago
• metoro-io / metoro-mcp-server
  Metoro MCP Server
  ☆46Updated 3 weeks ago
• microsoft / go-infra
  Infrastructure supporting the use of Go in Microsoft
  ☆36Updated this week
• NVIDIA / topograph
  A toolkit for discovering cluster network topology.
  ☆96Updated last week