Alternatives and similar repositories for regex-tokenizer

Users that are interested in regex-tokenizer are comparing it to the libraries listed below

• riddle911 / SuperInsights
  ☆65Updated 7 months ago
• wangyuxinwhy / generate
  A Python Package to Access World-Class Generative Models
  ☆127Updated 11 months ago
• shibing624 / agentica
  Agentica: Effortlessly Build Intelligent, Reflective, and Collaborative Multimodal AI Agents! 轻松构建智能、具备反思能力、可协作的多模态AI Agent。
  ☆158Updated this week
• intsig-textin / markdown_tester
  如需体验textin文档解析，请点击https://cc.co/16YSIy
  ☆93Updated 6 months ago
• chuanruihu / Level-Navi-Agent-Search
  The Level-Navi Agent, a framework that requires no training and utilizes large language models for deep query understanding and precise s…
  ☆79Updated 4 months ago
• liguodongiot / unify-easy-llm
  unify-easy-llm（ULM）旨在打造一个简易的一键式大模型训练工具，支持Nvidia GPU、Ascend NPU等不同硬件以及常用的大模型。
  ☆55Updated 9 months ago
• SmartFlowAI / Hand-on-RAG
  顾名思义：手搓的RAG
  ☆122Updated last year
• zjrwtx / SFT-data-builder
  利用免费的大模型api来结合你的私域数据来生成sft训练数据（妥妥白嫖）支持llamafactory等工具的训练数据格式synthetic data
  ☆160Updated 5 months ago
• shibing624 / SearchGPT
  SearchGPT: Building a quick conversation-based search engine with LLMs.
  ☆46Updated 4 months ago
• aidoczh / dspy-doc-zh
  DSPy中文文档
  ☆27Updated 11 months ago
• kv1830 / fast_pdf_trans
  Fast pdf translate是一款pdf翻译软件，基于MinerU实现pdf转markdown的功能，接着对markdown进行分割， 送给大模型翻译，最后组装翻译结果并由pypandoc生成结果pdf。
  ☆19Updated last month
• RapidAI / RapidLayout
  Analysis of Chinese and English layouts 中英文版面分析
  ☆208Updated last month
• taishan1994 / Qwen2-UIE
  基于Qwen2模型进行通用信息抽取【实体/关系/事件抽取】
  ☆31Updated 10 months ago
• MetaGLM / OpenLM
  本项目致力于为大模型领域的初学者提供全面的知识体系，包括基础和高阶内容，以便开发者能迅速掌握大模型技术栈并全面了解相关知识。
  ☆58Updated 4 months ago
• infinigence / InfiniWebSearch
  A demo built on Megrez-3B-Instruct, integrating a web search tool to enhance the model's question-and-answer capabilities.
  ☆38Updated 5 months ago
• dataelement / bisheng-unstructured
  bisheng-unstructured library
  ☆46Updated 2 weeks ago
• CLUEbenchmark / SuperCLUE-RAG
  中文原生检索增强生成测评基准
  ☆116Updated last year
• riddle911 / autobid
  ☆56Updated 2 months ago
• CrazyBoyM / LLM-Chinese
  （撰写ing..)本仓库偏教程性质，以「模型中文化」为一个典型的模型训练问题切入场景，指导读者上手学习LLM二次微调训练。
  ☆34Updated 9 months ago
• hustyichi / dify-eval
  基于 Dify + Langfuse 的自动化评估服务
  ☆57Updated 3 weeks ago
• tianchiguaixia / ocr_recognition
  微调阿里开源的文字检测模型，利用合合识别返回的OCR结果作为初始训练数据，对模型进行优化训练，使其更加适应1万张图片的具体场景，提高文字识别的精度。
  ☆9Updated 5 months ago
• RapidAI / RapidOCRPDF
  Based on RapidOCR, extract the PDF content
  ☆166Updated last week
• wey-gu / grpo-graph-extraction
  Qwen GRPO Graph Extraction RL Finetune
  ☆48Updated last month
• KMnO4-zx / TinyAgent
  基于ReAct手搓一个Agent Demo
  ☆130Updated 2 weeks ago
• ssbuild / aigc_data
  share data， prompt data , pretraining data
  ☆36Updated last year
• li-xiu-qi / x-pdf2md
  本项目借助飞桨平台，构建起一套创新的多模型协同系统，实现 PDF 文件到 Markdown 文件的高效、精准转换。
  ☆11Updated last month
• zzlgreat / smart_agent
  ☆105Updated last year
• 360AILAB-NLP / 360LayoutAnalysis
  360LayoutAnaylsis, a series Document Analysis Models and Datasets deleveped by 360 AI Research Institute
  ☆281Updated 8 months ago
• OKC13 / General-Documents-Layout-parser
  通用版面分析 | 中文文档解析 |Document Layout Analysis | layout paser
  ☆46Updated 11 months ago
• ArtificialZeng / Qwen-Tuning
  Qwen-Efficient-Tuning
  ☆43Updated last year