π OpenCrawl: An ethical, high-performance web crawler built for scale A powerful web crawling library that respects robots.txt and rate limits while leveraging Kafka for high-throughput data processing. Built with ethics and efficiency in mind.
β22Apr 3, 2025Updated last year
Alternatives and similar repositories for OpenCrawl
Users that are interested in OpenCrawl are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Powerful WiFi Hacking penetration testing tools for Linux, designed for ethical hacking, security testing, and network auditing.β18Nov 18, 2025Updated 5 months ago
- High-performance MCP server, code graph engine & evolutionary algorithm platform in Zig. 33 tools: GitHub project management, agent swarmβ¦β45Apr 19, 2026Updated last week
- DHI: High-Performance, WebAssembly-Powered TypeScript Validatorβ14Sep 2, 2025Updated 7 months ago
- Take a picture, get a 3D print of it!β12Dec 26, 2024Updated last year
- Rich text editor with AI text generation using TipTap project.β12Nov 15, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Hindi stardict dictsβ10Jan 14, 2026Updated 3 months ago
- Neural Network in Python from Scratchβ11Feb 18, 2023Updated 3 years ago
- The baseline method for CCIR 22 https://www.datafountain.cn/competitions/573β13Aug 2, 2022Updated 3 years ago
- Gradio UI to load crewAI configuration from excel xls and generate the python code. The source of the crews is in the xls. It allows for β¦β11Oct 17, 2025Updated 6 months ago
- Allow the `pm` CLI utility to install APKs from anywhere in your filesystemβ18Mar 30, 2024Updated 2 years ago
- Examples of how to use the Arduino millis() function.β10Apr 11, 2018Updated 8 years ago
- β22Jul 15, 2025Updated 9 months ago
- A toolkit to induce interpretable workflows from raw computer-use activities.β42Nov 13, 2025Updated 5 months ago
- Dartive is an ExpressJS-like wrapper for Dart backend, simplifying the process of defining routes and handling HTTP requests.β12Aug 2, 2023Updated 2 years ago
- End-to-end encrypted email - Proton Mail β’ AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- DeStringCare for extracting Android apk secretsβ15Oct 27, 2020Updated 5 years ago
- SATYA - High Performance Data Validation for Python written in Rustβ23Jan 24, 2026Updated 3 months ago
- A tutorial on how to build your own Neural Language Modelβ10Dec 8, 2022Updated 3 years ago
- π€οΈ Pathik - High-Performance Web Crawler β‘β31Mar 27, 2025Updated last year
- ηΎεΊ¦AIζ―θ΅οΌηΉε»εζ¬Ίθ―ι’ζ΅οΌζε7/424β13Jul 19, 2020Updated 5 years ago
- CrewAI-Agentic-Jira: Enhance your Jira workflows with intelligent agent-driven automation. Powered by the CrewAI framework, this project β¦β22Feb 3, 2025Updated last year
- Magisk module which adds SmartcardService (Open Mobile API 2.05)β12May 17, 2017Updated 8 years ago
- Autotools syntax highlighting for vscode (adapted from Sublime Text)β10Mar 5, 2023Updated 3 years ago
- open-deepsearchβ11Mar 3, 2025Updated last year
- Managed Database hosting by DigitalOcean β’ AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Certbot plugin for DNS using Websupport service.β12Jan 8, 2025Updated last year
- β‘ Bhumi β The fastest AI inference client for Python, built with Rust for unmatched speed, efficiency, and scalability πβ69Jan 22, 2026Updated 3 months ago
- The fastest FlashText library for Pythonβ26Jul 4, 2024Updated last year
- Icon themes for FreeCADβ21Nov 6, 2023Updated 2 years ago
- 3000+ machine-readable open source dictionaries distributed by the Applied Computational Linguistics lab at the University of Augsburg, Gβ¦β17Jul 19, 2023Updated 2 years ago
- pyGlobalPlatform is a free open source GlobalPlatform library that can be used to JavaCard and other smartcards. You can use it to write β¦β20Jul 20, 2017Updated 8 years ago
- cortex.llamacpp is a high-efficiency C++ inference engine for edge computing. It is a dynamic library that can be loaded by any server aβ¦β43Jul 4, 2025Updated 9 months ago
- STALE! This used to be a mirror of VPVR @ https://sourceforge.net/p/vpvr merged with 107Final branch @ https://sourceforge.net/u/djrobx/vβ¦β11Oct 23, 2022Updated 3 years ago
- Allows users of FatSecret.com to export their dataβ12Dec 4, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIAβs TensorRT-LLM for GPU aβ¦β42Sep 26, 2024Updated last year
- an unstructured data analytics systems via LLMβ26Aug 7, 2025Updated 8 months ago
- Simple image classifier that introduces machine learning with Codespacesβ21Sep 30, 2022Updated 3 years ago
- ANDRAX Hackers Platform.β23Mar 22, 2024Updated 2 years ago
- Example Cordova project using https://github.com/trevorpowell/mapbox-gl-js-cordova-offlineβ18Apr 20, 2016Updated 10 years ago
- EvilDroid automates the exploitation of CVE-2024-0044, installing malicious payloads on a target device and extracting sensitive data. Itβ¦β28Sep 6, 2025Updated 7 months ago
- β15Jul 11, 2022Updated 3 years ago