Alternatives and similar repositories for text-inference-batcher

Users that are interested in text-inference-batcher are comparing it to the libraries listed below

• Muhtasham / llm-inference-simulator

  View on GitHub
  🚀 LLM inference optimization simulator, modeling compute-bound prefill and memory-bound decode phases.
  ☆13Jul 12, 2025Updated 7 months ago
• EricLBuehler / candle_graphs

  View on GitHub
  Graph model execution API for Candle
  ☆17Jul 27, 2025Updated 6 months ago
• enjalot / latent-data-modal

  View on GitHub
  Using modal.com to process FineWeb-edu data
  ☆20Apr 5, 2025Updated 10 months ago
• YdrMaster / cuda-driver

  View on GitHub
  基于 CUDA Driver API 的 cuda 运行时环境
  ☆15Jul 30, 2025Updated 6 months ago
• facebookresearch / DIG-In

  View on GitHub
  This library supports evaluating disparities in generated image quality, diversity, and consistency between geographic regions.
  ☆20Jun 3, 2024Updated last year
• beyondExp / B-Llama3-o

  View on GitHub
  B-Llama3o a llama3 with Vision Audio and Audio understanding as well as text and Audio and Animation Data output.
  ☆26Jun 3, 2024Updated last year
• liuqi6777 / Awesome-LLM4Ranking

  View on GitHub
  A curated list of awesome papers about utilizing large language models for ranking.
  ☆31Oct 30, 2024Updated last year
• AutonomicPerfectionist / PipeInfer

  View on GitHub
  PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation
  ☆32Nov 16, 2024Updated last year
• Prismadic / magnet

  View on GitHub
  the small distributed language model toolkit; fine-tune state-of-the-art LLMs anywhere, rapidly
  ☆32Oct 19, 2024Updated last year
• llm-fine-tuning / trl

  View on GitHub
  fine-tuning tutorial
  ☆17Dec 13, 2025Updated 2 months ago
• pdpdds / DOSDev

  View on GitHub
  DOS Program Development
  ☆12Nov 9, 2022Updated 3 years ago
• enjalot / latent-sae

  View on GitHub
  Training code for Sparse Autoencoders on Embedding models
  ☆39Feb 27, 2025Updated 11 months ago
• taylorai / onnx_embedding_models

  View on GitHub
  utilities for loading and running text embeddings with onnx
  ☆45Aug 16, 2025Updated 5 months ago
• InfiniTensor / ninetoothed

  View on GitHub
  A domain-specific language (DSL) based on Triton but providing higher-level abstractions.
  ☆41Feb 4, 2026Updated last week
• facebookresearch / mexma

  View on GitHub
  MEXMA: Token-level objectives improve sentence representations
  ☆42Jan 6, 2025Updated last year
• nvidia-riva / common

  View on GitHub
  Protocol buffers and other common resources.
  ☆13Jan 20, 2026Updated 3 weeks ago
• ahnlabcloudmatelabs / backend-generator-ai

  View on GitHub
  ☆10Jan 9, 2024Updated 2 years ago
• yaman / fashion-clip-rs

  View on GitHub
  A complete(grpc service and lib) Rust inference with multilingual embedding support. This version leverages the power of Rust for both GR…
  ☆39Aug 20, 2024Updated last year
• RektPunk / Imbalance-LightGBM

  View on GitHub
  LightGBM for handling label-imbalanced data with focal and weighted loss functions in binary and multiclass classification
  ☆21Jan 29, 2026Updated 2 weeks ago
• miintto / redis-lock-py

  View on GitHub
  Redis distributed lock implementation for Python based on Pub/Sub messaging
  ☆11Nov 15, 2025Updated 2 months ago
• Gyeom / spring-data-jdbc-jooq-sample

  View on GitHub
  ☆14Dec 12, 2022Updated 3 years ago
• KirillRepinArt / ChatGPT-UI

  View on GitHub
  ChatGPT CSS style
  ☆14Apr 28, 2024Updated last year
• radiusxyz / delay-encryption-in-halo2

  View on GitHub
  ☆11Dec 6, 2023Updated 2 years ago
• zishen-ucap / LTX-Video-xDiT

  View on GitHub
  This project is based on the [LTX-Video](https://github.com/Lightricks/LTX-Video) algorithm of the diffusers and optimized and accelerate…
  ☆11Dec 31, 2024Updated last year
• taylorai / mlx_embedding_models

  View on GitHub
  run embeddings in MLX
  ☆97Sep 27, 2024Updated last year
• newrelic / k8s-agents-operator

  View on GitHub
  This project auto-instruments containerized workloads in Kubernetes with New Relic agents.
  ☆12Updated this week
• Hmbown / ZMLX

  View on GitHub
  Triton‑style kernel toolkit for MLX plus a small upstream incubator: prototype, benchmark, and upstream fusions for Apple Silicon
  ☆35Updated this week
• Zerohertz / Instruct_KR_2025_Summer_Meetup_vLLM

  View on GitHub
  🎹 Instruct.KR 2025 Summer Meetup: 오픈소스 LLM, vLLM으로 Production까지 🎹
  ☆24Aug 2, 2025Updated 6 months ago
• vbdi / epdserve

  View on GitHub
  [ICML 2025] Efficiently Serving Large Multimodal Models Using EPD Disaggregation
  ☆22May 29, 2025Updated 8 months ago
• covidclinical / visualization-notebooks

  View on GitHub
  Jupyter Notebooks and other code for 4CE data visualizations.
  ☆13Jan 25, 2023Updated 3 years ago
• sukso96100 / covid19-push

  View on GitHub
  코로나19 발생현황 변동 및 새 공지사항 푸시알림 서비스(질병관리본부 코로나19 홈페이지 데이터 이용)
  ☆12Jan 5, 2023Updated 3 years ago
• cometkim / deck-dev-dive-2022

  View on GitHub
  Dev Dive 2022 세션 "TDD: 내 코드의 품질을 높여주는 Type-Driven Development" 장표
  ☆12Nov 20, 2022Updated 3 years ago
• jesamkim / diagram-parsing

  View on GitHub
  Amazon Bedrock 의 Nova, Claude 3.7 모델을 활용하여 pdf 도면을 파싱 합니다.
  ☆12May 19, 2025Updated 8 months ago
• metterian / korean_bert_score

  View on GitHub
  BERT score for text generation
  ☆12Jan 15, 2025Updated last year
• stationmoney / station-assets

  View on GitHub
  🛰️ Assets for Station
  ☆13Aug 18, 2024Updated last year
• howsecureismypassword / modules-main

  View on GitHub
  The main HSIMP file
  ☆11Jul 28, 2017Updated 8 years ago
• drpebcak / terraform-k3s-aws-cluster

  View on GitHub
  ☆11Aug 24, 2022Updated 3 years ago
• liuqi6777 / pe_rank

  View on GitHub
  Leveraging passage embeddings for efficient listwise reranking with large language models.
  ☆50Dec 7, 2024Updated last year
• fengbinzhu / Doc2SoarGraph

  View on GitHub
  The repo of the Doc2SoarGraph framework
  ☆10Sep 17, 2024Updated last year