Alternatives and similar repositories for holodeck

Users that are interested in holodeck are comparing it to the libraries listed below

• go-skynet / go-ggml-transformers.cpp
  Binding to transformers in ggml
  ☆64Updated this week
• NVIDIA / k8s-operator-libs
  A collection of useful Go libraries to ease the development of NVIDIA Operators for GPU/NIC management.
  ☆25Updated 3 weeks ago
• kubernetes / dynamic-resource-allocation
  ☆39Updated this week
• openai / kubernetes
  Production-Grade Container Scheduling and Management
  ☆63Updated 4 months ago
• NVIDIA / go-nvlib
  A collection of useful Go libraries for use with NVIDIA GPU management tools
  ☆47Updated last week
• google-deepmind / multiscope
  Real-time visualisation
  ☆20Updated 2 months ago
• huggingface / candle-cublaslt
  ☆12Updated last year
• antirez / LLM-FTC-sampling
  First token cutoff sampling inference example
  ☆31Updated last year
• OthersideAI / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆11Updated 2 years ago
• coreweave / ml-containers
  ☆42Updated this week
• saracen / llama2.go
  Inference Llama 2 in Go
  ☆39Updated 2 years ago
• opendatahub-io / vllm-tgis-adapter
  vLLM adapter for a TGIS-compatible gRPC server.
  ☆45Updated this week
• cohere-ai / cohere-go
  Go Library for Accessing the Cohere API
  ☆69Updated last month
• NVIDIA / ais-k8s
  Kubernetes Operator, ansible playbooks, and production scripts for large-scale AIStore deployments on Kubernetes.
  ☆119Updated this week
• kubernetes / component-helpers
  High-level helpers for Kubernetes components
  ☆19Updated this week
• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆62Updated 2 months ago
• AI-Hypercomputer / inference-benchmark
  ☆17Updated 5 months ago
• NVIDIA / nim-anywhere
  Accelerate your Gen AI with NVIDIA NIM and NVIDIA AI Workbench
  ☆193Updated 7 months ago
• kubernetes / mount-utils
  Package mount defines an interface to mounting filesystems.
  ☆71Updated this week
• Intelligent-Internet / II-Commons
  This repository `II-Commons` contains tools for managing text and image datasets, including loading, fetching, and embedding large datase…
  ☆32Updated 4 months ago
• gomlx / gopjrt
  Go Wrappers for OpenXLA PJRT
  ☆33Updated this week
• 0x9ef / openai-go
  OpenAI GPT-3/3.5/4 API client written in Go
  ☆20Updated 2 years ago
• NVIDIA / k8s-driver-manager
  The NVIDIA Driver Manager is a Kubernetes component which assist in seamless upgrades of NVIDIA Driver on each node of the cluster.
  ☆46Updated this week
• kyegomez / Exa
  Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…
  ☆26Updated last year
• haormj / llama2.go
  Inference Llama 2 in one file of pure go
  ☆16Updated 2 years ago
• llm-d / llm-d-deployer
  Helm charts for llm-d
  ☆50Updated 4 months ago
• openshift / ib-sriov-cni
  InfiniBand SR-IOV CNI
  ☆14Updated 2 weeks ago
• github / go-pipe
  A package used to easily build command pipelines in your Go applications
  ☆54Updated this week
• kubernetes / system-validators
  A set of system-oriented validators for kubeadm preflight checks.
  ☆38Updated last month
• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆30Updated last year