liwenju0 / cutwordView external linksLinks
一个简单快速的分词、命名实体识别工具
☆631Sep 26, 2025Updated 4 months ago
Alternatives and similar repositories for cutword
Users that are interested in cutword are comparing it to the libraries listed below
Sorting:
- 更纯粹、更高压缩率的Tokenizer☆488Nov 27, 2024Updated last year
- Firefly: 大模型训练工具，支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、…☆6,635Oct 24, 2024Updated last year
- Question and Answer based on Anything.☆13,859Mar 24, 2025Updated 10 months ago
- BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）☆8,281Oct 16, 2024Updated last year
- 通用版面分析 | 中文文档解析 |Document Layout Analysis | layout paser☆48Jun 13, 2024Updated last year
- Retrieval and Retrieval-augmented LLMs☆11,280Dec 15, 2025Updated 2 months ago
- text2vec, text to vector. 文本向量表征工具，把文本转化为向量矩阵，实现了Word2Vec、RankBM25、Sentence-BERT、CoSENT等文本表征、文本相似度计算模型，开箱即用。☆4,935Nov 30, 2025Updated 2 months ago
- pycorrector is a toolkit for text error correction. 文本纠错，实现了Kenlm，T5，MacBERT，ChatGLM3，Qwen2.5等模型应用在纠错场景，开箱即用。☆6,368Jan 12, 2026Updated last month
- 中文 NLP 预处理、解析工具包，准确、高效、易用 A Chinese NLP Preprocessing & Parsing Package www.jionlp.com☆3,802Nov 27, 2025Updated 2 months ago
- 用于生成文本纠错模型(如Gector)需要的大量数据。☆14Jan 5, 2023Updated 3 years ago
- Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调☆3,730Oct 12, 2023Updated 2 years ago
- 基于ChatGLM-6B + LoRA的Fintune方案☆3,761Nov 25, 2023Updated 2 years ago
- 用于大模型 RLHF 进行人工数据标注排序的工具。A tool for manual response data annotation sorting in RLHF stage.☆256Aug 1, 2023Updated 2 years ago
- Netease Youdao's open-source embedding and reranker models for RAG products.☆1,858Sep 9, 2025Updated 5 months ago
- Easy, fast, and cheap pretrain,finetune, serving for everyone☆314Jul 16, 2025Updated 7 months ago
- The official codes for "Aurora: Activating chinese chat capability for Mixtral-8x7B sparse Mixture-of-Experts through Instruction-Tuning"☆263May 9, 2024Updated last year
- 人工精调的中文对话数据集和一段chatglm的微调代码☆1,195May 3, 2025Updated 9 months ago
- A PyTorch-based model pruning toolkit for pre-trained language models☆388Aug 31, 2023Updated 2 years ago
- 🩹Editing large language models within 10 seconds⚡☆1,361Aug 13, 2023Updated 2 years ago
- fastllm是后端无依赖的高性能大模型推理库。同时支持张量并行推理稠密模型和混合模式推理MOE模型，任意10G以上显卡即可推理满血DeepSeek。双路9004/9005服务器+单显卡部署DeepSeek满血满精度原版模型，单并发20tps；INT4量化模型单并发30tp…☆4,149Updated this week
- TigerBot: A multi-language multi-task LLM☆2,262Dec 28, 2024Updated last year
- MNBVC(Massive Never-ending BT Vast Chinese corpus)超大规模中文语料集。对标chatGPT训练的40T数据。MNBVC数据集不但包括主流文化，也包括各个小众文化甚至火星文的数据。MNBVC数据集包括新闻、作文、小说、书籍、杂志…☆4,120Jan 31, 2026Updated 2 weeks ago
- 语言模型中文认知能力分析☆235Sep 9, 2023Updated 2 years ago
- A large-scale 7B pretraining language model developed by BaiChuan-Inc.☆5,686Jul 18, 2024Updated last year
- Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain…☆37,291Nov 10, 2025Updated 3 months ago
- 中文Mixtral-8x7B（Chinese-Mixtral-8x7B）☆654Aug 17, 2024Updated last year
- 中文Mixtral混合专家大模型（Chinese Mixtral MoE LLMs）☆610Apr 30, 2024Updated last year
- TextGen: Implementation of Text Generation models, include LLaMA, BLOOM, GPT2, BART, T5, SongNet and so on. 文本生成模型，实现了包括LLaMA，ChatGLM，BLO…☆981Sep 14, 2024Updated last year
- ☆979Feb 7, 2025Updated last year
- chatglm多gpu用deepspeed和☆409Jul 8, 2024Updated last year
- ⭐️ NLP Algorithms with transformers lib. Supporting Text-Classification, Text-Generation, Information-Extraction, Text-Matching, RLHF, SF…☆2,409Sep 29, 2023Updated 2 years ago
- 中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)☆7,170Jul 15, 2025Updated 7 months ago
- Tuning LLMs with no tears💦; Sample Design Engineering (SDE) for more efficient downstream-tuning.☆1,018Apr 27, 2024Updated last year
- Fengshenbang-LM(封神榜大模型)是IDEA研究院认知计算与自然语言研究中心主导的大模型开源体系，成为中文AIGC和认知智能的基础设施。☆4,148Aug 13, 2024Updated last year
- A series of large language models developed by Baichuan Intelligent Technology☆4,118Nov 8, 2024Updated last year
- ☆234May 10, 2024Updated last year
- Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3, Qwen3-MoE, DeepSeek-R1, GLM4.5, InternLM3, Llama4, ...) and 300+ MLLMs (…☆12,670Updated this week
- 中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)☆18,964Jul 15, 2025Updated 7 months ago
- Imitate OpenAI with Local Models☆89Aug 27, 2024Updated last year