smilelight/lightSpider external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

smilelight/lightSpider

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/smilelight/lightSpider)

Close

smilelight / lightSpiderView on GitHubMore

• External links
• Readme badge

lightsmile个人的用于爬取网络公开语料数据的mini通用爬虫框架。

☆13Sep 30, 2020Updated 5 years ago

Alternatives and similar repositories for lightSpider

Users that are interested in lightSpider are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• mozih / easybuy-demo

  View on GitHub
  毕设项目，项目名称为轻松买比价网，通过爬虫获取各大电商平台中特定的商品的价格图片等数据，并在本系统中进行比价展示。 系统主要分为3个模块，用户模块，搜索模块，商品模块。
  ☆13Oct 10, 2022Updated 3 years ago
• Revenger666 / python-house-scrapy

  View on GitHub
  python-租房数据爬取和可视化分析
  ☆11Mar 6, 2024Updated 2 years ago
• justong86 / SpiderMaoYan

  View on GitHub
  只需输入一个猫眼电影的ID号，自动爬取评论内容，并生成可视化分析图表（包括词云图）
  ☆10Oct 25, 2018Updated 7 years ago
• CuriousLearnerDev / Infiltration_script

  View on GitHub
  简单的渗透测试小工具
  ☆22Apr 23, 2023Updated 2 years ago
• guosaike / django_ansible_webssh

  View on GitHub
  基于django+ansible+ansibleapi+webssh实现的运维自动化管理系统（可当毕业设计）
  ☆10Apr 21, 2023Updated 2 years ago
• lb2281075105 / LBDuoDian

  View on GitHub
  ☆21Jan 5, 2021Updated 5 years ago
• aicodex / Knowledge-Fusion-Tagging-tools

  View on GitHub
  知识融合标注工具
  ☆15Dec 19, 2018Updated 7 years ago
• johnontop / powcms

  View on GitHub
  Portable Offline Web CMS - A truly unique HTML Page Editor & Content Management System that creates a flat file HTML based website on you…
  ☆11Sep 25, 2020Updated 5 years ago
• yanqiangmiffy / competion-zoo

  View on GitHub
  比赛中的通用方法和模板
  ☆16Sep 8, 2020Updated 5 years ago
• bighuang624 / yuki

  View on GitHub
  使用 Node.js 开发的项目目录管理工具，能够将项目内文件结构自动映射并生成为 README.md | A project directory management tool, which helps you to map the file structure insi…
  ☆12Aug 10, 2018Updated 7 years ago
• YPYT1 / Boss_direct_hire

  View on GitHub
  基于BOSS直聘实现数据爬取与可视化分析项目，该项目是一个django项目，仅供个人学习使用
  ☆14Jan 21, 2024Updated 2 years ago
• direction-yxf / Hello-GPT

  View on GitHub
  接地气的大模型工程，争取成为一本大模型实战百科全书
  ☆16Oct 16, 2023Updated 2 years ago
• ddout / chinatax-crack

  View on GitHub
  发票查验--破解~~~
  ☆13Mar 10, 2017Updated 9 years ago
• learnerzhang / rasa_usage

  View on GitHub
  基于rasa_框架实现指自然语言相关功能:实体识别、文本分类、代消解功能、关系抽取等
  ☆17May 22, 2023Updated 2 years ago
• wolfbing / roadrunner

  View on GitHub
  datamining roadrunner
  ☆13Apr 5, 2016Updated 9 years ago
• zhexiao / mnet

  View on GitHub
  一个基于Softflowd，Kafka，Spark Streaming，Elk，Django开发的网络数据流监控分析后台， 支持Netflow V9与Netflow V5。可以对进入和流出的流量进行异常分析并执行自动化漏洞修复。
  ☆25Jun 10, 2021Updated 4 years ago
• gentrio / SocialGo

  View on GitHub
  社会化工具库（第三方分享和登录），支持微信、QQ、微博、钉钉。
  ☆17Feb 25, 2025Updated last year
• wangmingdong / ngTreeFrame

  View on GitHub
  基于Angular的树形组织结构指令
  ☆11May 8, 2022Updated 3 years ago
• thu-coai / LongSafety

  View on GitHub
  [ACL 2025] LongSafety: Evaluating Long-Context Safety of Large Language Models
  ☆16Jun 18, 2025Updated 9 months ago
• iriscxy / FES

  View on GitHub
  ☆26Nov 7, 2022Updated 3 years ago
• HXWfromDJTU / FlowerShop

  View on GitHub
  鲜花商城 是 移动端的HTML 5 商城APP，有客户端和管理端两部分，后端使用的是ThinkPHP框架
  ☆17Jul 10, 2018Updated 7 years ago
• zdou0830 / crosslingual_summarization_semantic

  View on GitHub
  ☆10Jun 13, 2020Updated 5 years ago
• smilelight / NLP-KG-Projects

  View on GitHub
  自己之前收集的自然语言处理和知识图谱相关的一些开源项目
  ☆50May 4, 2020Updated 5 years ago
• zjunlp / KnowRL

  View on GitHub
  KnowRL: Exploring Knowledgeable Reinforcement Learning for Factuality
  ☆40Dec 1, 2025Updated 3 months ago
• laruace / php-management-system

  View on GitHub
  基于star Framework , bootstrap 干净的后台管理系统， 包含菜单管理、用户和用户组管理、权限管理
  ☆12Nov 24, 2015Updated 10 years ago
• cordercorder / nmt-multi

  View on GitHub
  Codebase for multilingual neural machine translation
  ☆13Nov 24, 2022Updated 3 years ago
• DerrickYLJ / LessIsMore

  View on GitHub
  Less Is More: Training-Free Sparse Attention with Global Locality for Efficient Reasoning
  ☆29Sep 12, 2025Updated 6 months ago
• huihoo / book

  View on GitHub
  开放图书资源索引
  ☆19Oct 19, 2018Updated 7 years ago
• gdyszy / property-app

  View on GitHub
  智慧家园业主版 ---多小区物业管理系统APP 业主版
  ☆17Apr 17, 2025Updated 11 months ago
• rlistengr / retrieval-based-question-answering-system

  View on GitHub
  实现基于相似度匹配和检索的问答系统
  ☆18Jun 1, 2019Updated 6 years ago
• ThomasScialom / summa-qa

  View on GitHub
  Supporting code for the EMNLP 2019 paper "Answers Unite! Unsupervised Metrics for Reinforced Summarization Models"
  ☆14Jun 12, 2023Updated 2 years ago
• zide05 / CDEvalSumm

  View on GitHub
  ☆12Nov 3, 2022Updated 3 years ago
• ustctf-zz / delibnet

  View on GitHub
  ☆14Nov 16, 2022Updated 3 years ago
• TaiMingLu / know-dont-tell

  View on GitHub
  ☆19Oct 14, 2024Updated last year
• guoday / Dialog-to-Action

  View on GitHub
  The code for the 2018 NeurIPS paper "Dialog-to-Action: Conversational Question Answering Over a Large-Scale Knowledge Base"
  ☆38Oct 28, 2020Updated 5 years ago
• dothinking / tagit

  View on GitHub
  自定义层次分类和标签进行个人知识管理
  ☆10Apr 2, 2019Updated 6 years ago
• yhx9527 / graduate_project_yhx

  View on GitHub
  毕设项目--面向短视频的流量数据爬取和分析系统
  ☆39Jun 5, 2020Updated 5 years ago
• jackzhang1204 / piano-play

  View on GitHub
  基于html5的钢琴弹奏游戏
  ☆18Dec 26, 2013Updated 12 years ago
• csnlp / Transformer

  View on GitHub
  依照The Annotated Transformer 的指导实现Transformer, 并加入进去详细的描述，适合小白
  ☆11Feb 2, 2020Updated 6 years ago