smilelight/lightSpider external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

smilelight/lightSpider

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/smilelight/lightSpider)

Close

smilelight / lightSpiderView on GitHubMore

• External links
• Readme badge

lightsmile个人的用于爬取网络公开语料数据的mini通用爬虫框架。

☆13Sep 30, 2020Updated 5 years ago

Alternatives and similar repositories for lightSpider

Users that are interested in lightSpider are comparing it to the libraries listed below

• yanqiangmiffy / competion-zoo

  View on GitHub
  比赛中的通用方法和模板
  ☆16Sep 8, 2020Updated 5 years ago
• aicodex / Knowledge-Fusion-Tagging-tools

  View on GitHub
  知识融合标注工具
  ☆15Dec 19, 2018Updated 7 years ago
• learnerzhang / rasa_usage

  View on GitHub
  基于rasa_框架实现指自然语言相关功能:实体识别、文本分类、代消解功能、关系抽取等
  ☆17May 22, 2023Updated 2 years ago
• rlistengr / retrieval-based-question-answering-system

  View on GitHub
  实现基于相似度匹配和检索的问答系统
  ☆18Jun 1, 2019Updated 6 years ago
• pranavkumaarofficial / nlcli-wizard

  View on GitHub
  Natural language control for Python CLI tools using locally-trained SLMs (CPU inference)
  ☆30Feb 21, 2026Updated last week
• Thomkat / MBC

  View on GitHub
  MBC: Memory Bank Compression for Continual Adaptation of Large Language Models
  ☆20Sep 22, 2025Updated 5 months ago
• xunbu / lightrans

  View on GitHub
  windows端翻译软件。提供划词翻译、截图翻译、ai翻译等功能
  ☆12Apr 24, 2025Updated 10 months ago
• GanSusan / BLE-opensource

  View on GitHub
  2025年-阿里云天池-饿了么AI大赛赛道一：智慧养老 冠军
  ☆19Jun 30, 2025Updated 8 months ago
• yuanjie-ai / NlpCorpusWithLabel

  View on GitHub
  中文语料：大量人工标注样本，非常有价值 ！！！
  ☆11Aug 15, 2019Updated 6 years ago
• chromee / FullEmojiSupportApi

  View on GitHub
  ☆10May 21, 2021Updated 4 years ago
• xzuyn / ROCm-Guides

  View on GitHub
  Guides to hopefully simplify the process of using ROCm.
  ☆12Sep 26, 2024Updated last year
• guoday / Dialog-to-Action

  View on GitHub
  The code for the 2018 NeurIPS paper "Dialog-to-Action: Conversational Question Answering Over a Large-Scale Knowledge Base"
  ☆38Oct 28, 2020Updated 5 years ago
• mozih / easybuy-demo

  View on GitHub
  毕设项目，项目名称为轻松买比价网，通过爬虫获取各大电商平台中特定的商品的价格图片等数据，并在本系统中进行比价展示。 系统主要分为3个模块，用户模块，搜索模块，商品模块。
  ☆13Oct 10, 2022Updated 3 years ago
• dothinking / tagit

  View on GitHub
  自定义层次分类和标签进行个人知识管理
  ☆10Apr 2, 2019Updated 6 years ago
• Draco18s / NovelAPI

  View on GitHub
  ☆10Aug 30, 2025Updated 6 months ago
• computationalcore / vin-carnival

  View on GitHub
  Vin Carnival is a non-profit open source virtual reality game made with Unity 3D game engine and GoogleVR.
  ☆10Oct 3, 2018Updated 7 years ago
• wjtorres / tidytuesday

  View on GitHub
  These are my contributions to the weekly #TidyTuesday challenges!
  ☆11May 30, 2021Updated 4 years ago
• quarrying / khandy

  View on GitHub
  Handy Utilities for Computer Vision
  ☆12Updated this week
• riscv-admin / ai-ml

  View on GitHub
  AI-ML-NLP Task Group
  ☆13Aug 10, 2023Updated 2 years ago
• arc2r / book

  View on GitHub
  Work in Progress: A resource for people transitioning from ArcGIS to R for spatial stuff
  ☆13Mar 22, 2021Updated 4 years ago
• Revenger666 / python-house-scrapy

  View on GitHub
  python-租房数据爬取和可视化分析
  ☆11Mar 6, 2024Updated last year
• kevinfu1717 / multimediaChatbot

  View on GitHub
  构建了可用于多个对话框架的场景型对话的聊天机器人。支持吐槽类情景及情感倾诉型情景。使用wechaty，结合Paddlehub的人脸特征点、动漫人脸生成、对联生成、情感分类，ernie迁移，人脸变胖
  ☆37May 16, 2021Updated 4 years ago
• nrennie / dubois_challenge

  View on GitHub
  My attempts at recreating the visualisations by W.E.B. DuBois as part of the DuBois Challenge.
  ☆11Jan 5, 2023Updated 3 years ago
• thuhci / OpenRing

  View on GitHub
  Open Ring Platform for Multimodal Physiological and Behavioral Sensing (Ubicomp'25)
  ☆34Nov 24, 2025Updated 3 months ago
• mitmul / burn-captions

  View on GitHub
  Burn captions (.srt) into videos
  ☆10Oct 3, 2023Updated 2 years ago
• shibing624 / WebResearcher

  View on GitHub
  WebResearcher: An Iterative Deep-Research Agent，迭代式深度研究智能体
  ☆39Feb 13, 2026Updated 2 weeks ago
• xxxspy / baiduIndexDownloader

  View on GitHub
  A Chrome Extension downloader for Baidu search index.
  ☆11Oct 5, 2022Updated 3 years ago
• rngtm / URP14-ShadowSample

  View on GitHub
  URP14 Shadow Sample
  ☆13Nov 27, 2023Updated 2 years ago
• kcuilla / Tidy-Tuesday

  View on GitHub
  ☆15Mar 31, 2022Updated 3 years ago
• youseegreen / Unity_DesktopMascot_Framework

  View on GitHub
  Unityでデスクトップマスコットを作る際のフレームワーク、軽量にしたつもり
  ☆11Sep 9, 2020Updated 5 years ago
• framefield / vr-annotate

  View on GitHub
  a unity-package allows to make annotations on arbitrary Unity-scenes of architectural sites
  ☆15Dec 11, 2017Updated 8 years ago
• moriahtaylor1 / tidy-tuesday

  View on GitHub
  #TidyTuesday is a weekly social data project in R which encourages participants to summarize and arrange data to make meaningful charts w…
  ☆14Jun 10, 2025Updated 8 months ago
• iriscxy / FES

  View on GitHub
  ☆26Nov 7, 2022Updated 3 years ago
• drzqb / ChineseBERTTF

  View on GitHub
  带拼音、字形特征的文本纠错模型
  ☆11Jan 1, 2023Updated 3 years ago
• shibing624 / authorship-identification

  View on GitHub
  【今日头条】文本作者身份识别比赛
  ☆10Aug 20, 2018Updated 7 years ago
• biliqiqi / baklab-web

  View on GitHub
  Web frontend for BakLab. https://baklab.app
  ☆19Dec 26, 2025Updated 2 months ago
• ClericPy / watchdogs

  View on GitHub
  Keep an eye on the change of web world, everything can be RSS.
  ☆13Feb 9, 2025Updated last year
• zdou0830 / crosslingual_summarization_semantic

  View on GitHub
  ☆10Jun 13, 2020Updated 5 years ago
• Tinycompany-AI / tokenadapt

  View on GitHub
  0-Shot Tokenizer Transplant
  ☆14May 16, 2025Updated 9 months ago