Alternatives and similar repositories for holodeck

Users that are interested in holodeck are comparing it to the libraries listed below

• haormj / llama2.go
  Inference Llama 2 in one file of pure go
  ☆16Updated last year
• saracen / llama2.go
  Inference Llama 2 in Go
  ☆39Updated last year
• go-skynet / go-ggml-transformers.cpp
  Binding to transformers in ggml
  ☆62Updated last month
• antirez / LLM-FTC-sampling
  First token cutoff sampling inference example
  ☆30Updated last year
• huggingface / candle-cublaslt
  ☆13Updated last year
• vast-ai / vast-pyworker
  ☆11Updated last month
• NVIDIA / k8s-operator-libs
  A collection of useful Go libraries to ease the development of NVIDIA Operators for GPU/NIC management.
  ☆24Updated last week
• NVIDIA / go-nvlib
  A collection of useful Go libraries for use with NVIDIA GPU management tools
  ☆40Updated 2 weeks ago
• The-Swarm-Corporation / swarms-core
  Multi-threading, Concurrency, Asynchrony, and various Execution Methods implemented in a Rust backend for bleeding edge performance.
  ☆12Updated 7 months ago
• tensorchord / ai-infra-statistics
  This repository contains statistics about the AI Infrastructure products.
  ☆18Updated 3 months ago
• tspeterkim / cuda-1brc
  My CUDA solution to the 1BRC
  ☆10Updated last year
• sylabs / sif
  Singularity Image Format (SIF) reference implementation.
  ☆19Updated last week
• gpustack / gguf-packer-go
  Deliver LLMs of GGUF format via Dockerfile.
  ☆13Updated 8 months ago
• quic-go / qtls-go1-18
  Go standard library TLS 1.3 implementation, modified for QUIC. For Go 1.18.
  ☆19Updated 2 years ago
• google-deepmind / multiscope
  Real-time visualisation
  ☆17Updated this week
• ARM-software / golang-utils
  Helpers and utilities for Golang in order to do actions not available in the standard library.
  ☆33Updated last week
• llm-d / llm-d-kv-cache-manager
  Distributed KV cache coordinator
  ☆36Updated this week
• 0x9ef / openai-go
  OpenAI GPT-3/3.5/4 API client written in Go
  ☆20Updated 2 years ago
• paketo-buildpacks / libpak
  An opinionated extension to the libcnb Cloud Native Buildpack Library
  ☆15Updated 2 weeks ago
• tensorchord / llmspec
  OpenAI compatible API for open source LLMs
  ☆15Updated last year
• teilomillet / hapax
  The reliability layer between your code and LLM providers.
  ☆18Updated 5 months ago
• submariner-io / subctl
  CLI tool that provides helper commands to install, inspect, and troubleshoot a Submariner deployment.
  ☆27Updated this week
• kyegomez / CogNetX
  CogNetX is an advanced, multimodal neural network architecture inspired by human cognition. It integrates speech, vision, and video proce…
  ☆14Updated this week
• kubevela / prism
  API Extensions for core KubeVela.
  ☆14Updated 4 months ago
• kubernetes / dynamic-resource-allocation
  ☆37Updated last week
• EricLBuehler / zig_ml
  Tensor library for Zig
  ☆11Updated 7 months ago
• seversky / gachifinder
  ☆17Updated 3 years ago
• nexusflowai / NexusBench
  Nexusflow function call, tool use, and agent benchmarks.
  ☆20Updated 6 months ago
• microsoft / go-infra
  Infrastructure supporting the use of Go in Microsoft
  ☆28Updated this week
• multiprocessio / sqlite-cgo-no-cgo
  Benchmarking mattn/go-sqlite3 vs modernc.org/sqlite
  ☆12Updated 3 years ago