Alternatives and similar repositories for omni-infer

Users that are interested in omni-infer are comparing it to the libraries listed below

• wassemgtk / MegaScale-Infer-Prototyp

  View on GitHub
  Prototyp MegaScale-Infer: Serving Mixture-of-Experts at Scale with Disaggregated Expert Parallelism
  ☆26Apr 4, 2025Updated 10 months ago
• Ascend / MindSpeed-MM

  View on GitHub
  ☆31Updated this week
• Winnie-Lian / AHa_Meta_Cognitive

  View on GitHub
  ☆36Feb 2, 2026Updated 2 weeks ago
• kappital / kappital

  View on GitHub
  A Cloud-Native Service Catalog and Full Lifecycle Management Platform accross Multi-cloud and Edge
  ☆32Sep 28, 2023Updated 2 years ago
• kangyuzhe666 / Raspberry-operate-system-DIY

  View on GitHub
  基于树莓派ZREO BCM2835的简易树莓派操作系统 计算机科学与技术 操作系统课程设计
  ☆30Feb 13, 2020Updated 6 years ago
• IlyasMoutawwakil / py-txi

  View on GitHub
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆32Sep 19, 2025Updated 4 months ago
• bigai-nlco / Native-Parallel-Reasoner

  View on GitHub
  Official Repository of Native Parallel Reasoner
  ☆100Feb 5, 2026Updated last week
• hao-ai-lab / LookaheadReasoning

  View on GitHub
  [NeurIPS 2025] Scaling Speculative Decoding with Lookahead Reasoning
  ☆65Oct 31, 2025Updated 3 months ago
• MiniMax-AI / MiniMax-Provider-Verifier

  View on GitHub
  MiniMax-Provider-Verifier offers a rigorous, vendor-agnostic way to verify whether third-party deployments of the Minimax M2 model are co…
  ☆23Jan 15, 2026Updated last month
• zishen-ucap / LTX-Video-xDiT

  View on GitHub
  This project is based on the [LTX-Video](https://github.com/Lightricks/LTX-Video) algorithm of the diffusers and optimized and accelerate…
  ☆12Dec 31, 2024Updated last year
• NadavElias / DedupSearch

  View on GitHub
  ☆10Jan 31, 2022Updated 4 years ago
• Bigbidbot / CEX_Sniper

  View on GitHub
  SELL OPEN!! Sniping token. Purchase of tokens during listing on exchanges such as Binance, MEXC, OKEX, Huobi and Gate.io . Buy the very f…
  ☆11Feb 27, 2024Updated last year
• ujjawal-khare-27 / ray-kafka-producer

  View on GitHub
  Efficient Pandas and Ray Kafka Producer for python using actor model.
  ☆19Jan 18, 2024Updated 2 years ago
• nvidia-riva / common

  View on GitHub
  Protocol buffers and other common resources.
  ☆13Jan 20, 2026Updated 3 weeks ago
• rayleizhu / vllm-ra

  View on GitHub
  [ACL 2024] RelayAttention for Efficient Large Language Model Serving with Long System Prompts
  ☆40Feb 29, 2024Updated last year
• Cambricon / torch_mlu

  View on GitHub
  ☆54Mar 15, 2025Updated 11 months ago
• sgl-project / sgl-kernel-npu

  View on GitHub
  SGLang kernel library for NPU
  ☆97Updated this week
• vllm-project / vllm-ascend

  View on GitHub
  Community maintained hardware plugin for vLLM on Ascend
  ☆1,673Updated this week
• ChaseLab-PKU / ScalaAFA

  View on GitHub
  ScalaAFA: Constructing User-Space All-Flash Array Engine with Holistic Designs (USENIX ATC 2024).
  ☆12Nov 25, 2024Updated last year
• dut-laowang / PCLMM

  View on GitHub
  The code implementation for the article "Towards Patronizing and Condescending Language in Chinese Videos: A Multimodal Dataset and Fram…
  ☆15Apr 3, 2025Updated 10 months ago
• Social-AI-Studio / MultiHateClip

  View on GitHub
  Official repository for ACM Multimedia'24 paper "MultiHateClip: A Multilingual Benchmark Dataset for Hateful Video Detection on YouTube a…
  ☆17Aug 11, 2024Updated last year
• botbahlul / android-autosrt-v2

  View on GitHub
  ANDROID APP to AUTO GENERATE SUBTITLE FILE and TRANSLATED SUBTITLE FILE (using unofficial online Google Translate API) for any audio/vide…
  ☆19May 5, 2024Updated last year
• jingwei87 / sgxdedup

  View on GitHub
  sgx-based encrypted deduplication prototype
  ☆14May 14, 2021Updated 4 years ago
• ACA-Lab-SJTU / token-ring

  View on GitHub
  ☆13Jan 7, 2025Updated last year
• mllite / sklearn_explain

  View on GitHub
  Model explanation provides the ability to interpret the effect of the predictors on the composition of an individual score.
  ☆13Jan 21, 2021Updated 5 years ago
• Danny02 / JOpenCTM

  View on GitHub
  Java implementation of the openCTM Mesh compression file format
  ☆13Oct 12, 2020Updated 5 years ago
• Thinklab-SJTU / L2P-MIP

  View on GitHub
  ☆11Feb 26, 2024Updated last year
• Humpheh / nest-observe

  View on GitHub
  Unofficial API for observing Google Nest devices which works with Google authentication
  ☆13Jun 25, 2022Updated 3 years ago
• Visual-AI / JoVA

  View on GitHub
  JoVA: Unified Multimodal Learning for Joint Video-Audio Generation
  ☆30Dec 22, 2025Updated last month
• Roboterh / study_summary

  View on GitHub
  study_summary
  ☆10Aug 8, 2022Updated 3 years ago
• zionlion67 / hyper

  View on GitHub
  x86_64 toy hypervisor
  ☆10Nov 13, 2018Updated 7 years ago
• zhoujiawei3 / SafeMVDrive

  View on GitHub
  Official implementation for “SafeMVDrive: Multi-view Safety-Critical Driving Video Synthesis in the Real World Domain”
  ☆20Dec 11, 2025Updated 2 months ago
• kzkadc / gan-with-grl

  View on GitHub
  Chainer and PyTorch implementation of GAN with gradient reversal layer
  ☆10Mar 19, 2022Updated 3 years ago
• rse-ops / perfetto-compose

  View on GitHub
  Run perfetto with Docker and docker-compose (self signed certificates)
  ☆11Feb 1, 2023Updated 3 years ago
• fengbinzhu / Doc2SoarGraph

  View on GitHub
  The repo of the Doc2SoarGraph framework
  ☆10Sep 17, 2024Updated last year
• cz-5f / LoVoRA.github.io

  View on GitHub
  ☆36Dec 18, 2025Updated 2 months ago
• tilde-research / MoMoE-impl

  View on GitHub
  Memory optimized Mixture of Experts
  ☆73Jul 25, 2025Updated 6 months ago
• infinigence / FUSCO

  View on GitHub
  High-performance distributed data shuffling (all-to-all) library for MoE training and inference
  ☆112Dec 31, 2025Updated last month
• icf3 / zevios

  View on GitHub
  original 8bit CPU of ICF3-Z
  ☆12Feb 20, 2020Updated 5 years ago