open source, distributed, restful crawler engine
☆14Feb 3, 2015Updated 11 years ago
Alternatives and similar repositories for ants
Users that are interested in ants are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Browser-based annotation tool for Framenet☆16Jan 27, 2015Updated 11 years ago
- Data scraping for a more civilized age☆17Jun 12, 2014Updated 12 years ago
- a framework and language for exploring and analyzing feeds of social media data.☆23Jan 25, 2012Updated 14 years ago
- Narwhal is a keyword and KEY NARRATIVE manager that creates language-aware classes. Because Narhwal does not use NLP it avoids complexity…☆12Oct 16, 2018Updated 7 years ago
- Ketama Consistent Hashing in Cython☆18Sep 26, 2017Updated 9 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- C++ library to parse WARC files☆11Jan 27, 2019Updated 7 years ago
- Slinky, a high-performance web crawler / text analytics in Python, Redis, Hadoop, R, Gephi☆40Aug 30, 2010Updated 16 years ago
- 简单udp可靠通信☆15Dec 24, 2012Updated 13 years ago
- Smart DNS Switcher (dnspod)☆13May 11, 2016Updated 10 years ago
- 上行/下行网速显示☆11Feb 24, 2016Updated 10 years ago
- Everything About Hyperliquid Ecosystem☆11Aug 11, 2026Updated 2 months ago
- ☆10Jun 1, 2014Updated 12 years ago
- Simple Zeroconf/mDNS scanner written in Go with no external dependencies☆12Apr 20, 2021Updated 5 years ago
- WarcMiddleware lets users seamlessly download a mirror copy of a website when running a web crawl with the Python web crawler Scrapy.☆48Mar 19, 2018Updated 8 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A collection of implementations of fair ML algorithms☆12Jan 7, 2018Updated 8 years ago
- Presentation for the NYU Data Lab December 2015☆14Dec 2, 2015Updated 10 years ago
- GPGPU application notes and demos for x86/ARM + OpenCL/CUDA system.☆15May 12, 2018Updated 8 years ago
- Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.☆46Dec 4, 2017Updated 8 years ago
- A crawler, indexer, and query interface all in Python with distributed processing via Pyro4.☆23Mar 16, 2012Updated 14 years ago
- Small snippets of code we often find useful☆11Nov 9, 2019Updated 6 years ago
- Celery for Twisted: manage Celery tasks from twisted using the Deferred API☆14Jul 13, 2017Updated 9 years ago
- https://android.scraperclub.com This is an experimental technique to share mobile phones as scraper workers coordinated over a central se…☆20Mar 3, 2020Updated 6 years ago
- A design prototype for DocNow to learn with☆14Apr 8, 2017Updated 9 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Whoops to easySwoole framework 3.x☆11Jan 21, 2021Updated 5 years ago
- Project to get NewsBlur running on a cluster of VMs☆17Jul 8, 2022Updated 4 years ago
- check cmd execute☆14Feb 4, 2017Updated 9 years ago
- [UNMAINTAINED] Deploy, run and monitor your Scrapy spiders.☆12Apr 8, 2026Updated 6 months ago
- ☆10Jun 18, 2018Updated 8 years ago
- Real-time sushi detection app on iOS☆10Apr 9, 2018Updated 8 years ago
- Python script to find subdomains☆11Aug 22, 2025Updated last year
- Publish unread bookmarks from Pinboard for Kindle☆17Jul 9, 2014Updated 12 years ago
- SVETabBarController is a Tab Bar controller inspired by the tab system on Google Chrome for mobile. The tabbar is displayed on the top o…☆15Nov 19, 2013Updated 12 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- The Historian's WARC Toolkit☆16May 14, 2015Updated 11 years ago
- Private CTF scripts☆12Aug 7, 2024Updated 2 years ago
- Python WSGI Middleware for adding HTTP/S proxy support to any WSGI Application☆24Oct 27, 2020Updated 5 years ago
- This document proposes a way of standardising the structure, language, and grammar used in security policies.☆26Jan 29, 2018Updated 8 years ago
- ☆11Mar 30, 2017Updated 9 years ago
- A perceptual image difference matcher for Kiwi.☆17May 29, 2013Updated 13 years ago
- ☆12Jan 8, 2023Updated 3 years ago