isLinXu/regex-tokenizer external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

isLinXu/regex-tokenizer

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/isLinXu/regex-tokenizer)

Close

isLinXu / regex-tokenizerView on GitHubMore

• External links
• Readme badge

Converted the Jina Tokenizer regex pattern to python.

☆25Jun 10, 2026Updated 2 months ago

Alternatives and similar repositories for regex-tokenizer

Users that are interested in regex-tokenizer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• isLinXu / DatasetMarkerTool

  View on GitHub
  🔨🔨🔨Tool for making model training data set
  ☆20Nov 1, 2024Updated last year
• isLinXu / claude-code-book

  View on GitHub
  ☆26Apr 1, 2026Updated 5 months ago
• isLinXu / model-metrics-plot

  View on GitHub
  🔨🔨🔨(mmplot)used to draw graphs of multiple index parameters such as algorithm accuracy and speed of multiple deep learning models.
  ☆87Aug 22, 2024Updated 2 years ago
• isLinXu / vision-process-webui

  View on GitHub
  💡💡💡awesome compute vision app in gradio
  ☆59May 17, 2024Updated 2 years ago
• zhaohb / fastapi_tritonserver

  View on GitHub
  ☆28Nov 6, 2024Updated last year
• Wordpress hosting with auto-scaling - Free Trial Offer • Ad
  Fully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
• yzhangchuck / awesome-llm-reasoning-long2short-papers

  View on GitHub
  ☆17Apr 11, 2025Updated last year
• latent-variable / r1_reasoning_effort

  View on GitHub
  Forces DeepSeek R1 models to engage in extended reasoning by intercepting early termination tokens.
  ☆19Feb 12, 2025Updated last year
• Vision-CAIR / dochaystacks

  View on GitHub
  Document Haystacks: Vision-Language Reasoning Over Piles of 1000+ Documents, CVPR 2025
  ☆26Jan 25, 2025Updated last year
• MarioCSilva / RAG_QA_LLM

  View on GitHub
  Knowledge-Sharing Hub using RAG Q&A techniques with LLMs (Llama2 and ChatGPT)
  ☆11Nov 29, 2023Updated 2 years ago
• usail-hkust / benchmark_inference_time_computation_LLM

  View on GitHub
  [NeurIPS 2025] Bag of Tricks for Inference-time Computation of LLM Reasoning
  ☆16Sep 20, 2025Updated 11 months ago
• atmughrabi / OpenGraph

  View on GitHub
  OpenGraph is an open-source graph processing benchmarking suite written in pure C/OpenMP.
  ☆14Apr 27, 2024Updated 2 years ago
• ShigureLab / python-lib-starter

  View on GitHub
  Just a template for quickly creating a python library.
  ☆10Updated this week
• KMnO4-zx / paper-agent

  View on GitHub
  something for paper agent
  ☆11Dec 18, 2024Updated last year
• xuhongzuo / MIX

  View on GitHub
  ICDM19 - Anomaly Detection / Outlier Detection for Mixed data
  ☆14Dec 6, 2020Updated 5 years ago
• 1-Click AI Models by DigitalOcean Gradient • Ad
  Deploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
• shangjingbo1226 / ContrastSubgraphMining

  View on GitHub
  Contrast Subgraph Mining from Coherent Cores
  ☆13Feb 20, 2018Updated 8 years ago
• Aneureka / teddy

  View on GitHub
  🌏 Teddy is a tiny but scalable http server based on Java NIO, inspired by netty.
  ☆11Dec 26, 2019Updated 6 years ago
• percent4 / tensorflow_serving_examples

  View on GitHub
  利用tensorflow/serving进行单模型、多模型、同一模型多版本的部署，并进行模型预测，并用Prothemus进行服务监控。
  ☆11Feb 24, 2021Updated 5 years ago
• natureLanguageQing / new_energy_relation_center

  View on GitHub
  企业事件抽取
  ☆13May 20, 2021Updated 5 years ago
• youngjoey-ai / tracerag

  View on GitHub
  一个强调工程化、可观测、可测试、可扩展的 RAG 项目。TraceRAG 的目标不是只把答案“生成出来”，而是把文档导入、切块、向量化、检索、带来源回答、评估与后续 tracing 拆成可独立验证的阶段，逐步演进成一个可维护、可解释、可复盘的生产级 RAG。
  ☆15Apr 2, 2026Updated 5 months ago
• haoyue1313 / Daxpay

  View on GitHub
  ☆18Aug 19, 2024Updated 2 years ago
• yuanjie-ai / stopwords-zh

  View on GitHub
  中文停用词汇总，持续完善中，欢迎push共建
  ☆17Jun 12, 2023Updated 3 years ago
• unit-mesh / minions-data-prepare

  View on GitHub
  Unit Minions 的各种数据准备、处理脚本，诸如 OpenAI 处理、格式转换等等。
  ☆14Apr 21, 2023Updated 3 years ago
• liangdabiao / deep_search_write

  View on GitHub
  AI写作小工具方案：让2个智能体合作写出真正可用的图文并茂的帖子（微信公众号，小红书，博客）。1，写作智能体，2，知识库智能体。
  ☆30Jun 8, 2025Updated last year
• Wordpress hosting with auto-scaling - Free Trial Offer • Ad
  Fully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
• rsanshierli / Bert-Classification-EMA-AD

  View on GitHub
  Bert文本分类，EMA+AD
  ☆19May 19, 2020Updated 6 years ago
• zhaoxuangithub / event_extraction_zh

  View on GitHub
  中文事件抽取
  ☆11Feb 26, 2021Updated 5 years ago
• tedzhouhk / GCNP

  View on GitHub
  ☆16Dec 8, 2021Updated 4 years ago
• zjukg / EasySchema

  View on GitHub
  ☆38Jan 31, 2023Updated 3 years ago
• wuyike2000 / CoTKR

  View on GitHub
  ☆32Jan 13, 2025Updated last year
• intsig-textin / xparse-frontend

  View on GitHub
  Textin xParse Web 端集成 - React
  ☆192Feb 24, 2026Updated 6 months ago
• yandun72 / WBDC_2022_RANK15

  View on GitHub
  ☆16Feb 28, 2023Updated 3 years ago
• 0xWJ / code-judge

  View on GitHub
  ☆24Oct 10, 2025Updated 10 months ago
• zzlgreat / smart_agent

  View on GitHub
  ☆104Sep 24, 2023Updated 2 years ago
• Deploy on Railway without the complexity - Free Credits Offer • Ad
  Connect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
• TencentCloudADP / youtu-parsing

  View on GitHub
  Youtu-Parsing: Perception, Structuring and Recognition via High-Parallelism Decoding
  ☆75Aug 6, 2026Updated 3 weeks ago
• OpenBuddy / GrandSage

  View on GitHub
  ☆16May 31, 2024Updated 2 years ago
• jinghanzhang1998 / RATT

  View on GitHub
  RATT: A Thought Structure for Coherent and Correct LLM Reasoning
  ☆15Jul 11, 2024Updated 2 years ago
• Xls1994 / AI-chatbot

  View on GitHub
  基于langchain+gradio搭建本地个人助理
  ☆18Dec 21, 2025Updated 8 months ago
• EDDChang / TSRFormer-Transformer-Based-Two-stage-Refinement-for-Single-Image-Shadow-Removal

  View on GitHub
  ☆15Apr 13, 2023Updated 3 years ago
• waylandzhang / equity-signal-lab

  View on GitHub
  Lab: Dataset-agnostic equity returns prediction pipeline with time-series cross-validation
  ☆16Feb 17, 2026Updated 6 months ago
• libudu / renpy-deepl

  View on GitHub
  一个游览器脚本，通过deepl翻译网站进行快速大量的renpy多语言化机翻。
  ☆21Aug 1, 2025Updated last year