VENDORIZED in lucebox-hub. Fork of llama.cpp, ggml graph for lucebox inference engine
☆29Jul 8, 2026Updated 3 months ago
Alternatives and similar repositories for lucebox-ggml
Users that are interested in lucebox-ggml are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Block-FP8 (W8A16) on NVIDIA V100 / Volta (sm_70) for vLLM — the FP8 path upstream drops on Volta, tuned for sparse MoE.☆15Jul 10, 2026Updated 3 months ago
- An Enhanced TOP program to monitor your Nvidia DGX SPARK's Hardware☆12Jan 10, 2026Updated 9 months ago
- vLLM fork for Tesla V100☆15May 31, 2026Updated 5 months ago
- vLLM fork for Tesla V100 (SM70) — extends 1CatAI's AWQ support and adds GGUF support☆26Jun 20, 2026Updated 4 months ago
- LLM inference in C/C++☆24Oct 21, 2026Updated 2 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Benchmarks and notes for running modern LLMs with vLLM on 8x Tesla V100-32GB in 2026.☆23Jul 10, 2026Updated 3 months ago
- Velocity Kernel for the Samsung Galaxy S8/S8+ (dreamlte/dream2lte). (discontinued)☆10May 30, 2019Updated 7 years ago
- LLM speculative inference server for heterogeneous hardware & consumer GPUs☆2,977Updated this week
- FlowPrefill: Decoupling Preemption from Prefill Scheduling Granularity to Mitigate Head-of-Line Blocking in LLM Serving☆12Aug 3, 2026Updated 3 months ago
- Code for MPhil Thesis at University of Cambridge☆13Jun 10, 2024Updated 2 years ago
- ☆11Feb 7, 2025Updated last year
- Intrinsic Curiosity Module (ICM) + PPO on the Pyramid and PushBlock environment.☆12Sep 3, 2019Updated 7 years ago
- An MCP server to read MCP logs to debug directly inside the client☆16May 3, 2025Updated last year
- This is a repository for documenting the setup and performance of MI100s in popular inference engines.☆20Oct 8, 2026Updated 3 weeks ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- marlin_v100 是一个从 vLLM 主树中提取出来的最小 Marlin 独立开发工作区，聚焦于 Marlin dense 与 Marlin MoE 的源码开发、最小构建和轻量验证。它保留了核心 CUDA/C++ 实现、最小 Python 薄封装、生成器测试与主树回写…☆26Jul 2, 2026Updated 4 months ago
- Helm chart and Terraform modules for the JARVICE XE Hybrid Cloud HPC platform☆19Updated this week
- Hand-written NVFP4 W4A16 CUDA kernels for Volta☆181Aug 19, 2026Updated 2 months ago
- ☆11Jun 19, 2025Updated last year
- Knowledge graph of the Sovryn protocol☆14Jul 12, 2021Updated 5 years ago
- Companion code for "Python for Algorithmic Trading Efficient Markets, Backtesting, and Streaming".☆12Sep 6, 2026Updated 2 months ago
- ☆16Jan 14, 2025Updated last year
- MEV and FLASH bots and frontrun preventing☆12Oct 16, 2022Updated 4 years ago
- ☆18Jan 3, 2026Updated 10 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Live dashboard: fire N parallel streaming coding-agent runs at any OpenAI-compatible endpoint — per-run TTFT/tok-s/E2E, real kill switch,…☆27Jul 23, 2026Updated 3 months ago
- ☆10Jul 12, 2025Updated last year
- An open benchmark arena for coding agent harnesses, built for the Pi community☆12Oct 21, 2026Updated 2 weeks ago
- Blocknative_NFT_Mempool_Filter☆17Jan 3, 2022Updated 4 years ago
- A modular framework for building massively parallel agentic systems☆35Sep 8, 2025Updated last year
- Unlocking NVIDIA CMP 90HX (GA102): kernel 6.12☆46Aug 22, 2026Updated 2 months ago
- ☆35Oct 20, 2025Updated last year
- Sequential Monte Carlo Speculative Decoding☆53Aug 25, 2026Updated 2 months ago
- Fermion Research fork of llama.cpp: FV5/FV5B five-value ternary types for Neutrino GGUF packs (CPU + CUDA)☆14Sep 29, 2026Updated last month
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- An open standard for AI registries☆158Updated this week
- Free AI coding environment: Ollama + Python☆13Apr 21, 2026Updated 6 months ago
- ☆16Jun 28, 2026Updated 4 months ago
- 広告のないAndroid用ファイルマネージャー(端末とNAS/SMB。ファイルの中身もその場でプレビュー)☆18Updated this week
- The agent that grows with you☆14Oct 14, 2026Updated 3 weeks ago
- Simple Ethereum Faucet☆15Dec 10, 2022Updated 3 years ago
- A professional post-production, color grading, and sharpness suite for ComfyUI☆15Jun 9, 2026Updated 4 months ago