lizongying / go-crawler
A web crawling framework implemented in Golang, it is simple to write and delivers powerful performance. It comes with a wide range of practical middleware and supports various parsing and storage methods. Additionally, it supports distributed deployment. 基于golang实现的爬虫框架,编写简单,性能强劲。内置了丰富的实用中间件,支持多种解析、保存方式,支持分布式部署。
☆123Updated this week
Alternatives and similar repositories for go-crawler:
Users that are interested in go-crawler are comparing it to the libraries listed below
- ⚡️ A proxy packet capture tool implemented in Go, supports multiple protocols such as Http, Https, Ws, Wss, Tcp, Socks5, and can intercep…☆259Updated last year
- dilu完整版本,集成所有的插件,学习或者要开发后台,选这个没错。dilu是一个golang的快速开发脚手架,基于Gin + Gorm + Vue3 + Element plus(vue-pure-admin)Saas化设计,可支持多团队(租户),基础用户管理功能,jwt鉴…☆20Updated last week
- 巨量引擎marketing-api golang sdk☆101Updated this week
- AJ-Captcha行为验证码的Go实现包☆110Updated 10 months ago
- 抖音SDK☆171Updated last year
- 基于小红书 Web 端进行的请求封装。☆15Updated last year
- goctls 是 goctl 对 simple admin 的适配优化后的生成工具。 Goctls is the generating tools for simple admin.☆38Updated last week
- 使用 Golang+Chrome+OpenCV 破解腾讯滑块验证码☆98Updated 4 years ago
- 方便用户学习和调试PowerWechat接口功能☆92Updated 2 months ago
- 一个简洁的云存储 golang 库,兼容 amazon s3 协议,支持但不限于阿里云、腾讯云、七牛云、华为云、aws s3、minio。☆53Updated last year
- Golang 实现的 IP 代理池, 涉及到的技术点: go gorm proxy proxypool ip crawler 爬虫 mysql viper cobra☆132Updated 10 months ago
- 基于goframe v2的企业网站内容管理系统☆68Updated this week
- PowerX是一款以企业微信为基础的微信私域运营开放平台,帮助企业实现引流获客、精细运营。☆220Updated this week
- 安卓自动化golang SDK,支持云手机,稳定 高效且不强依赖ADB☆111Updated 9 months ago
- go admin: backend base on: go-kratos; frontend base on vue3, antdv, typescript, vben-admin☆124Updated last week
- Go 微服务框架,Router 基于 Gin 和 gRPC Gateway,同时支持 gRPC 和 HTTP,封装各种常用组件,开箱即用,专注业务。☆131Updated 2 months ago
- dilu简化版本,自己开发首选,一个golang的快速开发脚手架,基于Gin + Gorm + Vue3 + Element plus(vue-pure-admin)Saas化设计,可支持多团队(租户),基础用户管理功能,jwt鉴权,代码生成器,权限管理,表单构建,因夫人工…☆66Updated 3 weeks ago
- 以kratos 作为服务端接口框架,vue3作为前端框架的后台管理系统☆42Updated last year
- austin项目的golang版本,一个聚合消息推送平台☆90Updated 2 years ago
- Backend core modules for Crawlab☆50Updated 9 months ago
- The member's api service of Simple admin. Simple Admin 会员服务的Api服务。实现了会员管理,会员登录,第三方登录,手机和邮箱注册的登录等功能。☆16Updated last month
- golang版本ddddocr通用验证码识别☆16Updated 9 months ago
- 快手磁力引擎marketing-api golang sdk☆29Updated 4 months ago
- A Go backend project demo using GoFrameV2. The goal of the project is to empower developers to concentrate on the development of business…☆87Updated 9 months ago
- ☆147Updated 9 months ago
- gathertool是golang脚本化开发库,目的是提高对应场景程序开发的效率;轻量级爬虫库,接口测试&压力测试库,DB操作库等。☆53Updated 2 weeks ago
- 关键词/敏感词检测,支持通配符和标签分类 。( trie树 、DFA算法 )☆40Updated last month
- Echo & Gin & GoFiber & GoZero & Hertz & Kratos + Ant Design Pro 前后端分离的管理后台,Build Anything With Quark☆250Updated this week
- Shopsuite Go商城系统 - 基于Go + Golang + Uniapp + Vue + ElementUi + Goframe框架的新零售社交电商系统(除了go商城系统外,还有java商城系统及php商城系统),适用于企业新零售、批发商城、B2B商业系统、社交电…☆123Updated 6 months ago
- 基于`Golang`语言和`Gin`框架的个人微信系统,支持ChatGPT☆99Updated last year