文本分类是指在给定分类体系下 , 根据文本的内容自动确定文本类别的过程。首先我们根据scrapy爬虫根据中国知网URL的规律,爬取70多万条2014年公开的发明专利,然后通过数据清洗筛选出了60多万条含标签数据。通过TF-IDF对60多万条本文进行词频提取,依照词频排序提取前3000个词语形成语义词典,然后根据观察设置停用词。然后再用TF-IDF的方式对每个摘要进行词频选取,通过布尔模型,对比语义词典生成文本向量。然后对标签进行数字化转换。取90%的文本为训练集,10%的文本为测试集。用有监督学习的SVM算法对文本进行分类,(人类生活必需品、作业运输、化学冶金、纺织造纸、固定建筑物、机械工程、物理学、电学)分成8类
☆107Mar 14, 2018Updated 8 years ago
Alternatives and similar repositories for CNKI_Patent_SVM
Users that are interested in CNKI_Patent_SVM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 使用LDA+SVM进行文本的分类☆22Jul 23, 2017Updated 8 years ago
- 爬取专利信息的爬虫☆27Sep 27, 2016Updated 9 years ago
- Implementation of "Optimizing neural networks for patent classification" paper☆14Jun 24, 2019Updated 7 years ago
- Text Classification using Bag of Words and TF-IDF models with K-Nearest Neighbor Algorithm☆11Aug 2, 2017Updated 8 years ago
- The USPTO Patent Exploring Tool (UPET) provides Python code for downloading, parsing, and loading USPTO patent bulk data into a local MyS…☆34May 5, 2013Updated 13 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- SVM中文文本分类☆13Mar 13, 2022Updated 4 years ago
- 一个自然语言处理的可视化系统,实现自动生成词云图、文章关键信息提取、多文档主题分布、文本分类等功能,还有一些业务数据的可视化图表展示。☆38Jan 27, 2021Updated 5 years ago
- 基于scikit-learn实现对新浪新闻的文本分类,数据集为100w篇文档,总计10类,测试集与训练集1:1划分。分类算法采用SVM和Bayes,其中Bayes作为baseline。☆110Dec 24, 2018Updated 7 years ago
- 基于SVM的中文文本分类; python☆13May 24, 2019Updated 7 years ago
- 多标签文本分类☆53Jun 8, 2019Updated 7 years ago
- a spider for cnki patent content, just for study and commucation, no use for business.☆123Dec 21, 2017Updated 8 years ago
- 毕业论文代码 + 评论文本数据获取+数据清洗+文本数据向量化+将数据放进分类器(KNN+Naive Bayes+SVM)中训练+结果评估☆56May 17, 2022Updated 4 years ago
- 上市公司年报分析☆12Jul 16, 2019Updated 7 years ago
- “达观杯”长文本智能处理挑战赛。达观数据提供了一批长文本数据和分类信息,希望选手动用自己的智慧,结合当下最先进的NLP和人工智能技术,深入分析文本内在结构和语义信息,构建文本分类模型,实现精准分类。☆10Jul 20, 2018Updated 8 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- 中国知网专利爬虫☆20Dec 8, 2022Updated 3 years ago
- The crawler for data on web of science, especially focus on the analysis of citation data☆16Dec 14, 2018Updated 7 years ago
- pyspark+Word2Vec+Tfidf+LSH、文章相似性推荐☆26Mar 5, 2020Updated 6 years ago
- 中国常用法律查询手册 | Law-Book☆53Aug 31, 2022Updated 3 years ago
- Patent Classification with Machine Learning☆17Sep 25, 2019Updated 6 years ago
- Package to parse and analyze trademark data from the United States Patent and Trademark Office☆14Apr 5, 2017Updated 9 years ago
- lawa-plugin是Elasticsearch的中文分词插件,后端模型是由法律法规、案例、期刊语料统计而成,并具有新词发现功能。☆12Oct 26, 2020Updated 5 years ago
- 本项目主要研究大模型在单独的法律数据集上的效果,现在支持belle和chatglm相关的模型训练,预测,验证和在线部署, 另外增加爬虫代码,langchain,结合数据库预测等功能。☆12Jul 16, 2023Updated 3 years ago
- 人脸年龄识别☆24Apr 26, 2019Updated 7 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- NLP的一些小例子,如:文本分类、文本纠错、关键词提取、自动摘要等☆23Dec 12, 2018Updated 7 years ago
- 用word2vec方法 匹配两个句子 计算相似度☆10Apr 23, 2018Updated 8 years ago
- Application for processing Chinese text : Sentiment , Keywords , Abstract☆10Apr 13, 2017Updated 9 years ago
- RankNet, LambdaRank, LambdaMART, GBrank☆14Nov 16, 2013Updated 12 years ago
- 关系抽取个人实战总结以及开源工具包使用☆55Dec 5, 2018Updated 7 years ago
- 使用tf-idf, TextRank4ZH等不同方式从中文文本中提取关键字,从中文文本中提取摘要和关键词☆34Dec 12, 2018Updated 7 years ago
- 复现了论文《基于主题模型的短文本关键词抽取及扩展》的代码☆31Nov 11, 2020Updated 5 years ago
- 文本特征值提取,采用结巴将文本分词,tf-idf算法得到特征值 ,以及给出了idf词频文件的训练方法☆21Feb 11, 2017Updated 9 years ago
- Temporal and Causal Reasoning (dataset)☆10Apr 19, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Chinese version code for the paper "EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Tasks"☆11Jul 25, 2019Updated 6 years ago
- ☆11Oct 18, 2016Updated 9 years ago
- 爬取披露易网站港股上市公司年报pdf文件☆14Jan 13, 2021Updated 5 years ago
- A simple crawler about CNKI.一个简单的CNKI爬虫☆21Nov 5, 2014Updated 11 years ago
- SMiLE algorithm for multilabel classification for missing labels☆13Apr 20, 2021Updated 5 years ago
- NLP Keras BiLSTM+CRF☆53Jun 4, 2018Updated 8 years ago
- 本项目使用Keras实现R-BERT,在人物关系数据集上进行测试验证。☆10Apr 17, 2021Updated 5 years ago