isLinXu / regex-tokenizer
Converted the Jina Tokenizer regex pattern to python.
☆18Updated 3 weeks ago
Related projects: ⓘ
- 对langchain-ChatGLM项目各模块进行注释,增加了一些新的特性,修复了一些bug☆24Updated 10 months ago
- ☆57Updated this week
- 中文原生检索增强生成测评基准☆92Updated 5 months ago
- 顾名思义:手搓的RAG☆108Updated 6 months ago
- The complete training code of the open-source high-performance Llama model, including the full process from pre-training to RLHF.☆70Updated last year
- SmartSearch: Building a quick conversation-based search engine with LLMs.☆42Updated 4 months ago
- A Python Package to Access World-Class Generative Models☆124Updated 3 months ago
- Analysis of Chinese and English layouts 中英文版面分析☆94Updated 2 months ago
- dify's rag patch module☆15Updated last week
- ☆14Updated 3 months ago
- ☆33Updated this week
- TianGong-AI-Unstructure☆48Updated last week
- open-o1: Using GPT-4o with CoT to Create o1-like Reasoning Chains☆26Updated this week
- 演示 vllm 对中文大语言模型的神奇效果☆31Updated 10 months ago
- ☆104Updated 11 months ago
- ☆88Updated last month
- 通用版面分析 | 中文文档解析 |Document Layout Analysis | layout paser☆41Updated 3 months ago
- gpt_server是一个用于生产级部署LLMs或Embedding的开源框架。☆94Updated this week
- ChatGPT WebUI using gradio. 给 LLM 对话和检索知识问答RAG提供一个简单好用的Web UI界面☆84Updated 3 weeks ago
- accelerate generating vector by using onnx model☆10Updated 7 months ago
- 基于ReAct手搓一个Agent Demo☆99Updated 4 months ago
- ☆7Updated 3 months ago
- A light proxy solution for HuggingFace hub.☆43Updated 10 months ago
- doc2x docs☆29Updated 2 months ago
- baichuan and baichuan2 finetuning and alpaca finetuning☆32Updated 5 months ago
- (1)弹性区间标准化的旋转位置词嵌入编码器+peft LORA量化训练,提高万级tokens性能支持。(2)证据理论解释学习,提升模型的复杂逻辑推理能力(3)兼容alpaca数据格式。☆45Updated last year
- bisheng-unstructured library☆35Updated this week
- 眼科问诊大模型☆72Updated 2 months ago
- 部署你自己的OpenAI api🤩, 基于flask, transformers (使用 Baichuan2-13B-Chat-4bits 模型, 可以运行在单张Tesla T4显卡) ,实现了OpenAI中Chat, Models和Completions接口,包含流式响…☆85Updated 10 months ago
- the newest version of llama3,source code explained line by line using Chinese☆21Updated 5 months ago