在调研过程中，经常需要对一些网站进行定向抓取。由于python包含各种强大的库，使用python做定向抓取比较简单。请使用python开发一个迷你定向抓取器mini_spider.py，实现对种子链接的广度优先抓取，并把URL长相符合特定pattern的网页保存到磁盘上。
☆19Jun 24, 2015Updated 11 years ago
Alternatives and similar repositories for mini_spider
Users that are interested in mini_spider are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 迷你定向网页抓取器☆15Aug 29, 2016Updated 10 years ago
- 用于演示 git hooks 脚本的 DEMO☆10Jul 22, 2021Updated 5 years ago
- This is a chinese version of NLC model (forked from https://github.com/stanfordmlgroup/nlc)☆10Dec 7, 2017Updated 8 years ago
- We present ShoppingComp, a challenging real-world benchmark for rigorously evaluating LLM-powered shopping agents on three core capabilit…☆11Mar 9, 2026Updated 7 months ago
- ☆11Apr 29, 2019Updated 7 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Implementation of Dual Learning NMT & Joint Training on tensorflow☆12Dec 29, 2018Updated 7 years ago
- ☆15Jan 28, 2020Updated 6 years ago
- 关于一些网络硬盘（快盘，百度云）的objective-c 版本的SDK☆10Jan 14, 2013Updated 13 years ago
- Visual tool written in C++/QT5 wich helps designing sql databases☆12Mar 24, 2020Updated 6 years ago
- ☆13Mar 16, 2022Updated 4 years ago
- Python超级玛丽游戏手把手教程及代码☆11Dec 22, 2020Updated 5 years ago
- Take a screenshot of the page based on the provided urls 根据提供的urls，对页面进行截图☆10Dec 6, 2022Updated 3 years ago
- Data for SubTask A☆17Dec 13, 2021Updated 4 years ago
- LM pretraining for generation, reading list, resources, conference mappings.☆19Feb 25, 2020Updated 6 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 适用于低压伺服电机改装成高速主轴用驱动☆11Jul 28, 2023Updated 3 years ago
- A simple Python wrapper for the Dribbble API☆10Dec 7, 2013Updated 12 years ago
- chrome extension, localstorage eg☆10Feb 4, 2015Updated 11 years ago
- Use an esp32 as gateway for the Eqiva Bluetooth smart lock to integrate it in Home Assistant as MQTT lock☆10Mar 4, 2022Updated 4 years ago
- 最懂你的网盘搜索引擎☆11Sep 20, 2018Updated 8 years ago
- ☆14Jun 10, 2019Updated 7 years ago
- 星搭低代码AI助手插件，使用 StableDiffusion 和 ChatGPT 生成插画和文案☆11Mar 22, 2023Updated 3 years ago
- Code for ACL 2018 paper "Discourse Marker Augmented Network with Reinforcement Learning for Natural Language Inference".☆17Aug 5, 2018Updated 8 years ago
- 基于MPAndroidChart的专业股票图，如分时图和K线图☆11Sep 28, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- MQTT control of PWM capable pins on the Raspberry Pi - not strictly limited to lighting either...☆10Mar 10, 2014Updated 12 years ago
- Open Education Ontology☆18Oct 30, 2026Updated last week
- 深度学习是利用卷积网络的深层结构提取的信息，卷积网络目前主要用于图像识别分类技术，其实在其中间层中包含了丰富的有用信息，而这些正是风格迁移的基础。 如果研究 CNN 的各层级结构，会发现里面的每一层神经元的激活态都对应了一种特定的信息，越是底层的就越接近画面的纹理信息，如…☆10Aug 25, 2021Updated 5 years ago
- 通过抓取网页源码开发的一款看妹子的App 源网页☆15Jul 31, 2016Updated 10 years ago
- Simple web snapshot service☆10Jul 14, 2015Updated 11 years ago
- Main control terminal of educational UAV (PID Version)☆10May 23, 2020Updated 6 years ago
- ☆13Jul 7, 2022Updated 4 years ago
- Kotlin Android工具类库☆13Sep 1, 2024Updated 2 years ago
- TAE 无线导购 服务端☆11Aug 31, 2014Updated 12 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- use Tensorflow object detection API to detect hand and recognize different getures(5 types gestures)☆11Mar 30, 2018Updated 8 years ago
- A git mirror of python-dribbble.☆12Jul 29, 2010Updated 16 years ago
- ☆18Mar 26, 2026Updated 7 months ago
- RSS reader written in JavaScript.☆15Jun 17, 2020Updated 6 years ago
- 能够自动抓取股票数据、分析股票数据☆10Sep 3, 2015Updated 11 years ago
- A PID (proportional/integral/derivative) controller in Elixir. Not to be confused with process ID.☆11Apr 8, 2024Updated 2 years ago
- 基于mqtt的遥控器，在app上点击按钮，将码（空调码，电视码，风扇码）发送到mqqt，mqtt通过WiFi发给esp8266,esp8266解析转为红外，发出去。实现手机控制电视，风扇，空调。现已匹配到索尼电视，格力空调，奥美特风扇。☆10May 1, 2020Updated 6 years ago