isLinXu / regex-tokenizerLinks
Converted the Jina Tokenizer regex pattern to python.
☆26Updated 9 months ago
Alternatives and similar repositories for regex-tokenizer
Users that are interested in regex-tokenizer are comparing it to the libraries listed below
Sorting:
- A Python Package to Access World-Class Generative Models☆128Updated 11 months ago
- ☆66Updated 8 months ago
- bisheng-unstructured library☆48Updated 2 weeks ago
- 利用免费的大模型api来结合你的私域数据来生成sft训练数据(妥妥白嫖)支持llamafactory等工具的训练数据格式synthetic data☆164Updated 6 months ago
- 如需体验textin文档解析,请点击https://cc.co/16YSIy☆99Updated 6 months ago
- unify-easy-llm(ULM)旨在打造一个简易的一键式大模型训练工具,支持Nvidia GPU、Ascend NPU等不同硬件以及常用的大模型。☆55Updated 10 months ago
- 本项目致力于为大模型领域的初学者提供全面的知识体系,包括基础和高阶内容,以便开发者能迅速掌握大模型技术栈并全面了解相关知识。☆59Updated 4 months ago
- 顾名思义:手搓的RAG☆123Updated last year
- 中文原生检索增强生成测评基准☆118Updated last year
- vLLM Documentation in Chinese Simplified / vLLM 中文文档☆75Updated 3 weeks ago
- 基于Qwen2模型进行通用信息抽取【实体/关系/事件抽取】☆31Updated 10 months ago
- Agentica: Effortlessly Build Intelligent, Reflective, and Collaborative Multimodal AI Agents! 轻松构建智能、具备反思能力、可协作的多模态AI Agent。☆168Updated last week
- 本项目借助飞桨平台,构建起一套创新的多模型协同系统,实现 PDF 文件到 Markdown 文件的高效、精准转换。☆12Updated 2 months ago
- A demo built on Megrez-3B-Instruct, integrating a web search tool to enhance the model's question-and-answer capabilities.☆38Updated 5 months ago
- The Level-Navi Agent, a framework that requires no training and utilizes large language models for deep query understanding and precise s…☆79Updated 5 months ago
- SearchGPT: Building a quick conversation-based search engine with LLMs.☆46Updated 5 months ago
- ☆105Updated last year
- TianGong-AI-Unstructure☆65Updated last month
- 百度QA100万数据集☆47Updated last year
- ☆58Updated 3 months ago
- Fast pdf translate是一款pdf翻译软件,基于MinerU实现pdf转markdown的功能,接着对markdown进行分割, 送给大模型翻译,最后组装翻译结果并由pypandoc生成结果pdf。☆23Updated 2 months ago
- Qwen GRPO Graph Extraction RL Finetune☆49Updated 2 months ago
- Qwen-Efficient-Tuning☆43Updated last year
- accelerate generating vector by using onnx model☆17Updated last year
- ☆112Updated 10 months ago
- 在RAG技术中,嵌入向量的生成和匹配是关键环节。本文介绍了一种基于CLIP/BLIP模型的嵌入服务,该服务支持文本和图像的嵌入生成与相似度计算,为多模态信息检索提供了基础能力。☆26Updated 5 months ago
- 如需体验textin文档解析,请点击https://cc.co/16YSIy☆22Updated 10 months ago
- Finetune Llama 3, Mistral & Gemma LLMs 2-5x faster with 80% less memory☆27Updated last year
- gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR和TTS的开源框架。☆184Updated last week
- 探索 LLM 在法律行业的应用潜力☆89Updated 5 months ago