lizongying / go-crawlerLinks
A web crawling framework implemented in Golang, it is simple to write and delivers powerful performance. It comes with a wide range of practical middleware and supports various parsing and storage methods. Additionally, it supports distributed deployment. 基于golang实现的爬虫框架,编写简单,性能强劲。内置了丰富的实用中间件,支持多种解析、保存方式,支持分布式部署。
☆141Updated last month
Alternatives and similar repositories for go-crawler
Users that are interested in go-crawler are comparing it to the libraries listed below
Sorting:
- 使用 Golang+Chrome+OpenCV 破解腾讯滑块验证码☆105Updated 4 years ago
- ⚡️ A proxy packet capture tool implemented in Go, supports multiple protocols such as Http, Https, Ws, Wss, Tcp, Socks5, and can intercep…☆265Updated 2 years ago
- 抖音SDK☆178Updated last year
- 可视化任务调度系统,精简到一个二进制文件 (Web visual task scheduler system , yes ! just one binary solve all the problems !)☆191Updated last year
- Digger is a powerful and flexible web crawler implemented by pure golang☆193Updated 3 years ago
- Geek's valuable collection. A cross-platform supertool that brings convinience to coding.☆132Updated last year
- gathertool是golang脚本化开发库,目的是提高对应场景程序开发的效率;轻量级爬虫库,接口测试&压力测试库,DB操作库等。☆55Updated last month
- 基于goframe v2的企业网站内容管理系统☆86Updated 2 weeks ago
- go 常用加密解密库/go encrypt or decrypt pkg(RSA/SM2/ECDSA/EC-GDSA/Gost/ElGamal/AES/DES/TripleDes/SM4/Tea/Twofish)☆334Updated last month
- 安卓自动化golang SDK,支持云手机,稳定高效且不强依赖ADB☆134Updated last year
- AJ-Captcha行为验证码的Go实现包☆113Updated last year
- 基于小红书 Web 端进行的请求封装。☆15Updated 2 years ago
- Go 微服务框架,Router 基于 Gin 和 gRPC Gateway,同时支持 gRPC 和 HTTP,封装各种常用组件,开箱即用,专注业务。☆135Updated 2 weeks ago
- Echo & Gin & GoFiber & GoZero & Hertz & Kratos + Ant Design Pro 前后端分离的管理后台,Build Anything With Quark☆278Updated this week
- Golang 实现的 IP 代理池, 涉及到的技术点: go gorm proxy proxypool ip crawler 爬虫 mysql viper cobra☆141Updated last month
- golang 开箱即用的秒级分布式定时任务系统☆590Updated 2 weeks ago
- 巨量引擎marketing-api golang sdk☆110Updated last week
- dilu完整版本,集成所有的插件,学习或者要开发后台,选这个没错。dilu是一个golang的快速开发脚手架,基于Gin + Gorm + Vue3 + Element plus(vue-pure-admin)Saas化设计,可支持多团队(租户),基础用户管理功能,jwt鉴…☆23Updated 2 weeks ago
- 方便用户学习和调试PowerWechat接口功能☆97Updated 2 weeks ago
- 基于`Golang`语言和`Gin`框架的个人微信系统,支持ChatGPT☆100Updated 2 years ago
- 使用Golang wails为GUI框架编写的某音客户端,集成登录,搜索,多线程数据抓取☆12Updated 2 years ago
- dilu简化版本,自己开发首选,一个golang的快速开发脚手架,基于Gin + Gorm + Vue3 + Element plus(vue-pure-admin)Saas化设计,可支持多团队(租户),基础用户管理功能,jwt鉴权,代码生成器,权限管理,表单构建,因夫人工…☆68Updated 2 weeks ago
- goctls 是 goctl 对 simple admin 的适配优化后的生成工具。 Goctls is the generating tools for simple admin.☆41Updated last week
- GoFly快速开发框架基于Gin快速开发框架,能快速搭建应用、框架底层完善、丰富代码仓插件、快速开发 数据大屏、物联网平台、OA流程审批、工作流引擎、商城、微信管理后台等。api文档管理并一键生成api接口代码,一键生成 CRUD前后端代码丰富组件,基于 Gin和 Vue3的…☆471Updated 7 months ago
- Gin + Casbin(RBAC)+ Vue3 + AntDesignVue + AntdvPro☆136Updated last month
- Example of using the Go GUI library XCGUI. 炫彩界面库Go语言版例子☆55Updated 2 weeks ago
- 一个简洁的云存储 golang 库,兼容 amazon s3 协议,支持但不限于阿里云、腾讯云、七牛云、华为云、aws s3、minio。☆54Updated last year
- 基于golang+react18的后台管理系统,力求适中简化后台开发过程,满足中小项目开发需要。目前根据自身需要正不断迭代完善中☆66Updated 3 weeks ago
- 基于gf框架的token插件,通过服务端验证方式实现token认证;☆299Updated 3 months ago
- AnQiCMS 的后端管理代码。AnQiCMS 是一款基于Go语言开发,具备高安全性、高性能和易扩展性的企业级内容管理系统。它支持多站点、多语言管理,能够满足全球化跨境运营需求。☆17Updated 2 months ago