Alternatives and similar repositories for regex-tokenizer:

Users that are interested in regex-tokenizer are comparing it to the libraries listed below

• zjrwtx / SFT-data-builder
  利用免费的大模型api来结合你的私域数据来生成sft训练数据（妥妥白嫖）支持llamafactory等工具的训练数据格式synthetic data
  ☆154Updated 4 months ago
• dataelement / bisheng-unstructured
  bisheng-unstructured library
  ☆42Updated last week
• intsig-textin / markdown_tester
  如需体验textin文档解析，请点击https://cc.co/16YSIy
  ☆83Updated 4 months ago
• wangyuxinwhy / generate
  A Python Package to Access World-Class Generative Models
  ☆128Updated 9 months ago
• SmartFlowAI / Hand-on-RAG
  顾名思义：手搓的RAG
  ☆121Updated last year
• aJupyter / ThinkLLM
  ThinkLLM：大语言模型算法与组件实现
  ☆27Updated last week
• RapidAI / RapidLayout
  Analysis of Chinese and English layouts 中英文版面分析
  ☆187Updated last week
• taishan1994 / Qwen2-UIE
  基于Qwen2模型进行通用信息抽取【实体/关系/事件抽取】
  ☆30Updated 8 months ago
• riddle911 / SuperInsights
  ☆63Updated 6 months ago
• shibing624 / SearchGPT
  SearchGPT: Building a quick conversation-based search engine with LLMs.
  ☆45Updated 2 months ago
• shibing624 / agentica
  Agentica: Effortlessly Build Intelligent, Reflective, and Collaborative Multimodal AI Agents! 轻松构建智能、具备反思能力、可协作的多模态AI Agent。
  ☆145Updated 3 weeks ago
• chuanruihu / Level-Navi-Agent-Search
  The Level-Navi Agent, a framework that requires no training and utilizes large language models for deep query understanding and precise s…
  ☆78Updated 3 months ago
• zzlgreat / smart_agent
  ☆105Updated last year
• intsig-textin / acge_text_embedding
  ☆16Updated 7 months ago
• CLUEbenchmark / SuperCLUE-RAG
  中文原生检索增强生成测评基准
  ☆115Updated 11 months ago
• t6am3 / law_glm_baseline
  ☆16Updated 9 months ago
• duanyu / LabelFast
  中文世界的NLP自动标注开源工具，简单样本，交给LabelFast。
  ☆66Updated 2 months ago
• 360AILAB-NLP / 360LayoutAnalysis
  360LayoutAnaylsis, a series Document Analysis Models and Datasets deleveped by 360 AI Research Institute
  ☆271Updated 6 months ago
• shell-nlp / gpt_server
  gpt_server是一个用于生产级部署LLMs或Embedding的开源框架。
  ☆163Updated this week
• hustyichi / dify-eval
  基于 Dify + Langfuse 的自动化评估服务
  ☆48Updated 3 months ago
• liguodongiot / unify-easy-llm
  unify-easy-llm（ULM）旨在打造一个简易的一键式大模型训练工具，支持Nvidia GPU、Ascend NPU等不同硬件以及常用的大模型。
  ☆55Updated 8 months ago
• wey-gu / grpo-graph-extraction
  Qwen GRPO Graph Extraction RL Finetune
  ☆43Updated last month
• gameofdimension / vllm-cn
  演示 vllm 对中文大语言模型的神奇效果
  ☆31Updated last year
• lutongyv / Textin_Tester
  如需体验textin文档解析，请点击https://cc.co/16YSIy
  ☆22Updated 8 months ago
• WalkerMitty / PDFparser
  Here is a demo for PDF parser (Including OCR, object detection tools)
  ☆34Updated 5 months ago
• billvsme / my_openai_api
  部署你自己的OpenAI api🤩, 基于flask, transformers (使用 Baichuan2-13B-Chat-4bits 模型, 可以运行在单张Tesla T4显卡) ，实现了OpenAI中Chat, Models和Completions接口，包含流式响…
  ☆93Updated last year
• Laoyu84 / 4onebench
  A minimalist benchmarking tool designed to test the routine-generation capabilities of LLMs.
  ☆21Updated 4 months ago
• RapidAI / RapidDoc
  📝 针对文档类图像做内容提取，将文档类图像一比一输出到Word或者Txt中，便于进一步使用或处理。后续计划支持输入PDF/图像，输出对应json格式、Txt格式、Word格式和Markdown格式。
  ☆188Updated 5 months ago
• SUSTech-IDEA / SUS-Chat
  SUS-Chat: Instruction tuning done right
  ☆48Updated last year
• llmapp / openai
  Implement OpenAI APIs and plugin-enabled ChatGPT with open source LLM and other models.
  ☆120Updated 9 months ago