文本分类是指在给定分类体系下 , 根据文本的内容自动确定文本类别的过程。首先我们根据scrapy爬虫根据中国知网URL的规律，爬取70多万条2014年公开的发明专利，然后通过数据清洗筛选出了60多万条含标签数据。通过TF-IDF对60多万条本文进行词频提取，依照词频排序提取前3000个词语形成语义词典，然后根据观察设置停用词。然后再用TF-IDF的方式对每个摘要进行词频选取，通过布尔模型，对比语义词典生成文本向量。然后对标签进行数字化转换。取90%的文本为训练集，10%的文本为测试集。用有监督学习的SVM算法对文本进行分类，（人类生活必需品、作业运输、化学冶金、纺织造纸、固定建筑物、机械工程、物理学、电学）分成8类
☆107Mar 14, 2018Updated 8 years ago
Alternatives and similar repositories for CNKI_Patent_SVM
Users that are interested in CNKI_Patent_SVM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 爬取专利信息的爬虫☆30Sep 27, 2016Updated 10 years ago
- 本项目，旨在通过软件来爬取中国知识产权局的专利信息，并将爬取后的信息写入到 Excel 中。 其意义在于可以将大量网页内容整齐地写入到一个文档中。提高效率，减轻手工量。☆11May 10, 2020Updated 6 years ago
- Implementation of "Optimizing neural networks for patent classification" paper☆14Jun 24, 2019Updated 7 years ago
- The USPTO Patent Exploring Tool (UPET) provides Python code for downloading, parsing, and loading USPTO patent bulk data into a local MyS…☆34May 5, 2013Updated 13 years ago
- Qimen表示的是奇门遁甲之术，用于抽取各种实体的工具。☆29Jan 12, 2020Updated 6 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- 一个自然语言处理的可视化系统，实现自动生成词云图、文章关键信息提取、多文档主题分布、文本分类等功能，还有一些业务数据的可视化图表展示。☆38Jan 27, 2021Updated 5 years ago
- 基于scikit-learn实现对新浪新闻的文本分类，数据集为100w篇文档，总计10类，测试集与训练集1:1划分。分类算法采用SVM和Bayes，其中Bayes作为baseline。☆110Dec 24, 2018Updated 7 years ago
- 基于SVM的中文文本分类; python☆13May 24, 2019Updated 7 years ago
- 📃您身边的AI法律顾问(比赛项目)☆24Feb 26, 2024Updated 2 years ago
- 多标签文本分类☆53Jun 8, 2019Updated 7 years ago
- 毕业论文代码 + 评论文本数据获取+数据清洗+文本数据向量化+将数据放进分类器（KNN+Naive Bayes+SVM）中训练+结果评估☆56May 17, 2022Updated 4 years ago
- “达观杯”长文本智能处理挑战赛。达观数据提供了一批长文本数据和分类信息，希望选手动用自己的智慧，结合当下最先进的NLP和人工智能技术，深入分析文本内在结构和语义信息，构建文本分类模型，实现精准分类。☆10Jul 20, 2018Updated 8 years ago
- Java利用HtmlUtil和jsoup爬取知网中国专利数据的爬虫程序☆16Mar 21, 2019Updated 7 years ago
- The crawler for data on web of science, especially focus on the analysis of citation data☆16Dec 14, 2018Updated 7 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 中国知网专利爬虫☆21Dec 8, 2022Updated 3 years ago
- pyspark+Word2Vec+Tfidf+LSH、文章相似性推荐☆26Mar 5, 2020Updated 6 years ago
- Tornado结合Apscheduler的简单任务调度系统（包含数据采集、报表生成等）☆11Feb 24, 2018Updated 8 years ago
- 本仓库收录了我的毕业论文所使用的全部代码。 毕业论文题目《年报文本语气能预示股价崩盘风险吗？——基于 A 股上市公司年报的文本挖掘》。已被本科生毕业论文相关文献库收录，因此您可以查阅论文的正文。☆17Aug 12, 2021Updated 5 years ago
- 公开数据库的法律文件爬取并进行关键字检索☆19May 24, 2022Updated 4 years ago
- pytorch版损失函数，改写自科学空间文章，【通过互信息思想来缓解类别不平衡问题】、【将“softmax+交叉熵”推广到多标签分类问题】☆12Aug 22, 2021Updated 5 years ago
- 2021软件杯-新闻智分系统项目开源，基于PaddleHub通过预训练模型ERNIE-Tiny在整合与爬取的新闻10分类数据集上进行微调完成模型训练，可实现精细的新闻长文本10分类任务。最后基于PyQt5完成GUI可视化界面开发以及基于VUE+FastAPI完成该项目的we…☆24Jan 25, 2022Updated 4 years ago
- PatentSBERTa: A Deep NLP based Hybrid Model for Patent Distance and Classification using Augmented SBERT☆124Nov 3, 2024Updated last year
- The enhanced RCNN model used for sentence similarity classification☆43May 30, 2021Updated 5 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Patent Classification with Machine Learning☆17Sep 25, 2019Updated 7 years ago
- Demo of a Solana NFT Marketplace☆11Sep 14, 2022Updated 4 years ago
- 中国法律快查手册☆12Aug 19, 2025Updated last year
- 爬专利局的数据☆11Aug 10, 2015Updated 11 years ago
- Chinese word segmentation algorithm based on entropy（基于熵，无需语料库的中文分词）☆11Feb 27, 2018Updated 8 years ago
- 中国常用法律查询手册 | Law-Book☆56Aug 31, 2022Updated 4 years ago
- lawa-plugin是Elasticsearch的中文分词插件，后端模型是由法律法规、案例、期刊语料统计而成，并具有新词发现功能。☆12Oct 26, 2020Updated 6 years ago
- 本项目主要研究大模型在单独的法律数据集上的效果，现在支持belle和chatglm相关的模型训练，预测，验证和在线部署， 另外增加爬虫代码，langchain，结合数据库预测等功能。☆12Jul 16, 2023Updated 3 years ago
- 使用scik-learn 实现k-means，KNN,SVM,贝叶斯，topic_extraction等算法，同时评估分类的准确率，召回率和F值。语料库是中文文本☆43Jul 23, 2017Updated 9 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 用word2vec方法 匹配两个句子 计算相似度☆10Apr 23, 2018Updated 8 years ago
- 人脸年龄识别☆24Apr 26, 2019Updated 7 years ago
- 可实现异构应用系统间的数据转换、信息传递和业务的编排与重组☆13Nov 16, 2022Updated 3 years ago
- （已失效）自动生成知网期刊文献Bibtex并导入Zotero；自定义无csl文件的Zotero文献导出样式，在任何引用格式需求下实现随写随引；（已被Zotero6.0Beta实现）将所需知网文献批量、自动化导入Zotero。☆12Sep 26, 2024Updated 2 years ago
- 中文文本摘要/关键词提取☆436Dec 28, 2020Updated 5 years ago
- A python module to scrape patents from 'https://patents.google.com/'.☆108Nov 26, 2023Updated 2 years ago
- Application for processing Chinese text : Sentiment , Keywords , Abstract☆10Apr 13, 2017Updated 9 years ago