An LLM API gateway framework
☆19Aug 10, 2026Updated this week
Alternatives and similar repositories for octollm
Users that are interested in octollm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- d.run website☆18Updated this week
- ☆11Dec 13, 2023Updated 2 years ago
- Relief Mapping Demo☆13Aug 18, 2011Updated 14 years ago
- mmdetection -> TVM☆15Aug 22, 2020Updated 5 years ago
- Yet another Polyhedra Compiler for DeepLearning☆19Apr 14, 2023Updated 3 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆14May 28, 2019Updated 7 years ago
- Convert JSON to TypeScript interfaces☆18Sep 2, 2021Updated 4 years ago
- Code for algorithmic problems☆13Nov 1, 2021Updated 4 years ago
- vue全家桶+element+echarts后台管理系统，重构项目，包含完整的前端工程化☆15Feb 28, 2023Updated 3 years ago
- LightRFT (Light Reinforcement Fine-Tuning) is an advanced reinforcement learning fine-tuning framework designed for Large Language Models…☆19Jan 12, 2026Updated 6 months ago
- Repo for SpecEE: Accelerating Large Language Model Inference with Speculative Early Exiting (ISCA25)☆75Apr 25, 2025Updated last year
- Go language binding for Kùzu graph database management system☆43Oct 10, 2025Updated 10 months ago
- RLinf: Reinforcement Learning Infrastructure for Embodied and Agentic AI☆4,500Updated this week
- An Open Source Kepler GPU Assembler☆22Jan 23, 2017Updated 9 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆28Oct 25, 2021Updated 4 years ago
- Efficient LDA solution on GPUs.☆24Aug 20, 2018Updated 7 years ago
- CVFusion is an open-source deep learning compiler to fuse the OpenCV operators.☆33Aug 31, 2022Updated 3 years ago
- A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained compute isolation.☆129Dec 25, 2025Updated 7 months ago
- ☆33Sep 17, 2024Updated last year
- ☆128Dec 24, 2024Updated last year
- ☆40Feb 28, 2020Updated 6 years ago
- Simulate quantization and quantization aware training for MXNet-Gluon models.☆44Apr 17, 2020Updated 6 years ago
- Sample programs for the LLVM PTX back-end☆41Aug 27, 2015Updated 10 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆46Oct 15, 2025Updated 9 months ago
- CL Offline Compiler : Compile OpenCL kernels to HSAIL☆51May 5, 2017Updated 9 years ago
- A benchmark suited especially for deep learning operators☆43Feb 13, 2023Updated 3 years ago
- Experimental usage of stable-fast and TensorRT.☆209Aug 4, 2024Updated 2 years ago
- CUDA Tensor Transpose (cuTT) library☆55Aug 10, 2017Updated 9 years ago
- Kimi-Vendor-Verifier☆102Updated this week
- Integer Set Library (source repository: http://repo.or.cz/w/isl.git)☆76Apr 20, 2026Updated 3 months ago
- An Efficient Pipelined Data Parallel Approach for Training Large Model☆76Dec 11, 2020Updated 5 years ago
- Third party assembler and GEMM library for NVIDIA Kepler GPU☆86Oct 8, 2019Updated 6 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Encapsulate the frequently used AVX instructions as independent modules to reduce repeated development workload.☆130Jan 13, 2024Updated 2 years ago
- 🎉 A high quality component library built on Vue.js 2.0☆117Aug 2, 2021Updated 5 years ago
- Flexible GPGPU instrumentation☆91Oct 10, 2019Updated 6 years ago
- Composable and Embeddable Communication Runtime for Distributed AI Services☆102Jun 5, 2026Updated 2 months ago
- Benchmark of TVM quantized model on CUDA☆112Jun 19, 2020Updated 6 years ago
- Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, T…☆487Updated this week
- examples for tvm schedule API☆101Jun 12, 2023Updated 3 years ago