Alternatives and similar repositories for regex-tokenizer

Users that are interested in regex-tokenizer are comparing it to the libraries listed below

• wangyuxinwhy / generate
  A Python Package to Access World-Class Generative Models
  ☆128Updated 11 months ago
• riddle911 / SuperInsights
  ☆66Updated 8 months ago
• dataelement / bisheng-unstructured
  bisheng-unstructured library
  ☆48Updated 2 weeks ago
• zjrwtx / SFT-data-builder
  利用免费的大模型api来结合你的私域数据来生成sft训练数据（妥妥白嫖）支持llamafactory等工具的训练数据格式synthetic data
  ☆164Updated 6 months ago
• intsig-textin / markdown_tester
  如需体验textin文档解析，请点击https://cc.co/16YSIy
  ☆99Updated 6 months ago
• liguodongiot / unify-easy-llm
  unify-easy-llm（ULM）旨在打造一个简易的一键式大模型训练工具，支持Nvidia GPU、Ascend NPU等不同硬件以及常用的大模型。
  ☆55Updated 10 months ago
• MetaGLM / OpenLM
  本项目致力于为大模型领域的初学者提供全面的知识体系，包括基础和高阶内容，以便开发者能迅速掌握大模型技术栈并全面了解相关知识。
  ☆59Updated 4 months ago
• SmartFlowAI / Hand-on-RAG
  顾名思义：手搓的RAG
  ☆123Updated last year
• CLUEbenchmark / SuperCLUE-RAG
  中文原生检索增强生成测评基准
  ☆118Updated last year
• hyperai / vllm-cn
  vLLM Documentation in Chinese Simplified / vLLM 中文文档
  ☆75Updated 3 weeks ago
• taishan1994 / Qwen2-UIE
  基于Qwen2模型进行通用信息抽取【实体/关系/事件抽取】
  ☆31Updated 10 months ago
• shibing624 / agentica
  Agentica: Effortlessly Build Intelligent, Reflective, and Collaborative Multimodal AI Agents! 轻松构建智能、具备反思能力、可协作的多模态AI Agent。
  ☆168Updated last week
• li-xiu-qi / x-pdf2md
  本项目借助飞桨平台，构建起一套创新的多模型协同系统，实现 PDF 文件到 Markdown 文件的高效、精准转换。
  ☆12Updated 2 months ago
• infinigence / InfiniWebSearch
  A demo built on Megrez-3B-Instruct, integrating a web search tool to enhance the model's question-and-answer capabilities.
  ☆38Updated 5 months ago
• chuanruihu / Level-Navi-Agent-Search
  The Level-Navi Agent, a framework that requires no training and utilizes large language models for deep query understanding and precise s…
  ☆79Updated 5 months ago
• shibing624 / SearchGPT
  SearchGPT: Building a quick conversation-based search engine with LLMs.
  ☆46Updated 5 months ago
• zzlgreat / smart_agent
  ☆105Updated last year
• linancn / TianGong-AI-Unstructure
  TianGong-AI-Unstructure
  ☆65Updated last month
• CyberCommy / baidu-qa-100w
  百度QA100万数据集
  ☆47Updated last year
• riddle911 / autobid
  ☆58Updated 3 months ago
• kv1830 / fast_pdf_trans
  Fast pdf translate是一款pdf翻译软件，基于MinerU实现pdf转markdown的功能，接着对markdown进行分割， 送给大模型翻译，最后组装翻译结果并由pypandoc生成结果pdf。
  ☆23Updated 2 months ago
• wey-gu / grpo-graph-extraction
  Qwen GRPO Graph Extraction RL Finetune
  ☆49Updated 2 months ago
• ArtificialZeng / Qwen-Tuning
  Qwen-Efficient-Tuning
  ☆43Updated last year
• amulil / vector_by_onnxmodel
  accelerate generating vector by using onnx model
  ☆17Updated last year
• chrschy / fact-finder
  ☆112Updated 10 months ago
• pydaxing / clip_blip_embedding_rag
  在RAG技术中，嵌入向量的生成和匹配是关键环节。本文介绍了一种基于CLIP/BLIP模型的嵌入服务，该服务支持文本和图像的嵌入生成与相似度计算，为多模态信息检索提供了基础能力。
  ☆26Updated 5 months ago
• lutongyv / Textin_Tester
  如需体验textin文档解析，请点击https://cc.co/16YSIy
  ☆22Updated 10 months ago
• yangjianxin1 / unsloth
  Finetune Llama 3, Mistral & Gemma LLMs 2-5x faster with 80% less memory
  ☆27Updated last year
• shell-nlp / gpt_server
  gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR和TTS的开源框架。
  ☆184Updated last week
• MetaGLM / LawGLM
  探索 LLM 在法律行业的应用潜力
  ☆89Updated 5 months ago