Self-hosted huggingface mirror service. 自建huggingface镜像服务。
☆217Jul 16, 2025Updated 7 months ago
Alternatives and similar repositories for olah
Users that are interested in olah are comparing it to the libraries listed below
Sorting:
- Variant optimization autoscaler for distributed inference workloads☆33Updated this week
- The Volcano Descheduler☆23Jan 24, 2025Updated last year
- Test Orchestrator for Performance and Scalability of AI pLatforms☆16Feb 27, 2026Updated last week
- Helm charts for llm-d☆52Jul 22, 2025Updated 7 months ago
- fast IP to CIDR lookup, longest prefix match in golang☆11Feb 3, 2024Updated 2 years ago
- A collection of useful Go libraries to ease the development of NVIDIA Operators for GPU/NIC management.☆29Updated this week
- EpochFS is a versioned cloud file system with git-like branching, transaction support.☆17Feb 3, 2026Updated last month
- Deliver LLMs of GGUF format via Dockerfile.☆15Oct 24, 2024Updated last year
- 💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSI…☆26Dec 6, 2024Updated last year
- ☆31Apr 19, 2025Updated 10 months ago
- Simple implementation of a GPT (training and inference) in PyTorch.☆13Dec 11, 2023Updated 2 years ago
- dbSurface is a SQL editor made for pgvector.☆23Dec 6, 2025Updated 3 months ago
- 4G GPU & 10 Minutes for train☆12Aug 9, 2023Updated 2 years ago
- Resident (inotify) Anti-Malware Scanner using rules from Linux Malware Detect project☆11Jul 5, 2014Updated 11 years ago
- [WIP] Transformer to embed Danbooru labelsets☆13Mar 31, 2024Updated last year
- IPA Phonemizer/Dephonemizer for 140 human languages☆55Feb 11, 2026Updated 3 weeks ago
- Curriculum training of instruction-following LLMs with Unsloth☆14Dec 15, 2025Updated 2 months ago
- A simple extendable markdown extension for the php twig template engine.☆11Jul 31, 2023Updated 2 years ago
- Self-hosted TOTP authenticator PWA with FIDO2 (WebAuthn)☆15Updated this week
- ☆17Dec 19, 2024Updated last year
- ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!☆293Jan 26, 2026Updated last month
- Cloud Native Benchmarking of Foundation Models☆45Jul 31, 2025Updated 7 months ago
- A distributed system for Agentic AI☆47Updated this week
- A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.☆197Dec 23, 2025Updated 2 months ago
- ☆18Mar 18, 2024Updated last year
- ☆16Dec 12, 2023Updated 2 years ago
- A side project that follows all the acceleration tricks in tinyllama, with the minimal modification to the huggingface transformers code.☆13Sep 2, 2024Updated last year
- ktransformers v0.3 docker build and run☆13Feb 24, 2025Updated last year
- Module, Model, and Tensor Serialization/Deserialization☆290Feb 6, 2026Updated last month
- Using modal.com to process FineWeb-edu data☆20Apr 5, 2025Updated 11 months ago
- ☆20Updated this week
- A Lustre container storage interface that allows Kubernetes to mount/unmount provisioned Lustre filesystems into containers.☆45Updated this week
- Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, T…☆384Updated this week
- Hok: Higher-Order GPU Kernels☆23Dec 4, 2025Updated 3 months ago
- ☆22Updated this week
- Command-line tools for managing OCI model artifacts, which are bundled based on Model Spec☆63Mar 3, 2026Updated last week
- (R&D) Text to speech using phonemes as inputs and audio codec codes as outputs. Loosely based on MegaByte, VALL-E and Encodec.☆48Sep 4, 2023Updated 2 years ago
- ☆19Dec 4, 2025Updated 3 months ago
- Package extnetip extends the stdlib with a few missing but important auxiliary functions for converting IP-prefixes to IP-ranges and vice…☆24Nov 26, 2025Updated 3 months ago