lizongying / go-crawlerLinks
A web crawling framework implemented in Golang, it is simple to write and delivers powerful performance. It comes with a wide range of practical middleware and supports various parsing and storage methods. Additionally, it supports distributed deployment. 基于golang实现的爬虫框架，编写简单，性能强劲。内置了丰富的实用中间件，支持多种解析、保存方式，支持分布式部署。
☆134Updated 2 months ago
Alternatives and similar repositories for go-crawler
Users that are interested in go-crawler are comparing it to the libraries listed below
Sorting:
- ⚡️ A proxy packet capture tool implemented in Go, supports multiple protocols such as Http, Https, Ws, Wss, Tcp, Socks5, and can intercep…☆263Updated last year
- 抖音SDK☆178Updated last year
- AJ-Captcha行为验证码的Go实现包☆111Updated last year
- 使用 Golang+Chrome+OpenCV 破解腾讯滑块验证码☆103Updated 4 years ago
- 基于小红书 Web 端进行的请求封装。☆15Updated last year
- 基于goframe v2的企业网站内容管理系统☆76Updated last month
- gathertool是golang脚本化开发库，目的是提高对应场景程序开发的效率；轻量级爬虫库，接口测试&压力测试库，DB操作库等。☆56Updated 3 months ago
- Golang 实现的 IP 代理池, 涉及到的技术点: go gorm proxy proxypool ip crawler 爬虫 mysql viper cobra☆135Updated last year
- dilu完整版本，集成所有的插件，学习或者要开发后台，选这个没错。dilu是一个golang的快速开发脚手架，基于Gin + Gorm + Vue3 + Element plus（vue-pure-admin）Saas化设计，可支持多团队（租户），基础用户管理功能，jwt鉴…☆21Updated 3 months ago
- Go 微服务框架，Router 基于 Gin 和 gRPC Gateway，同时支持 gRPC 和 HTTP，封装各种常用组件，开箱即用，专注业务。☆131Updated 5 months ago
- Digger is a powerful and flexible web crawler implemented by pure golang☆193Updated 2 years ago
- 方便用户学习和调试PowerWechat接口功能☆92Updated 2 months ago
- Backend core modules for Crawlab☆50Updated last year
- Echo & Gin & GoFiber & GoZero & Hertz & Kratos + Ant Design Pro 前后端分离的管理后台，Build Anything With Quark☆261Updated last month
- 可视化任务调度系统，精简到一个二进制文件 (Web visual task scheduler system , yes ! just one binary solve all the problems !)☆191Updated last year
- Geek's valuable collection. A cross-platform supertool that brings convinience to coding.☆133Updated last year
- goctls 是 goctl 对 simple admin 的适配优化后的生成工具。 Goctls is the generating tools for simple admin.☆39Updated this week
- Gin + Casbin（RBAC）+ Vue3 + AntDesignVue + AntdvPro☆99Updated 2 months ago
- golang 开箱即用的秒级分布式定时任务系统☆571Updated this week
- auth api☆15Updated 4 months ago
- go-admin外部核心代码库，为go-admin提供原生代码支持，发展go-admin自身周边生态☆124Updated this week
- austin项目的golang版本,一个聚合消息推送平台☆91Updated 2 years ago
- go 常用加密解密库/go encrypt or decrypt pkg（RSA/SM2/ECDSA/EC-GDSA/Gost/ElGamal/AES/DES/TripleDes/SM4/Tea/Twofish）☆327Updated this week
- 基于 golang goframe + vue3 的、前后端分离的后台管理系统快捷使用模板，支持按钮级别的 RBAC。☆54Updated last year
- 通用yaml配置文件生成 gorm dao & modal 文件☆15Updated 4 months ago
- 以kratos 作为服务端接口框架，vue3作为前端框架的后台管理系统☆46Updated last year
- Distributed scheduled task management platform Go语言实现的分布式定时任务管理平台，支持多节点部署，支持节点任务自动分配和故障转移☆96Updated 2 years ago
- 扩展 go-zero 框架，能通过内置模板或外部模块一键创建项目，并基 于 proto/api/sql 等可描述文件生成服务端/客户端/数据库代码，开箱即用并高度可定制化.☆106Updated this week
- go-rod API 中文文档☆64Updated 2 years ago
- golang json字段过滤，复用struct 随意选择你想要输出为json的结构体字段。 json filter Golang's JSON filter randomly selects the structure fields you want to output …☆134Updated 7 months ago