π OpenCrawl: An ethical, high-performance web crawler built for scale A powerful web crawling library that respects robots.txt and rate limits while leveraging Kafka for high-throughput data processing. Built with ethics and efficiency in mind.
β19Apr 3, 2025Updated 11 months ago
Alternatives and similar repositories for OpenCrawl
Users that are interested in OpenCrawl are comparing it to the libraries listed below
Sorting:
- Powerful WiFi Hacking penetration testing tools for Linux, designed for ethical hacking, security testing, and network auditing.β16Nov 18, 2025Updated 4 months ago
- DHI: High-Performance, WebAssembly-Powered TypeScript Validatorβ15Sep 2, 2025Updated 6 months ago
- Take a picture, get a 3D print of it!β12Dec 26, 2024Updated last year
- Rich text editor with AI text generation using TipTap project.β12Nov 15, 2023Updated 2 years ago
- Hindi stardict dictsβ10Jan 14, 2026Updated 2 months ago
- Neural Network in Python from Scratchβ10Feb 18, 2023Updated 3 years ago
- The baseline method for CCIR 22 https://www.datafountain.cn/competitions/573β13Aug 2, 2022Updated 3 years ago
- Gradio UI to load crewAI configuration from excel xls and generate the python code. The source of the crews is in the xls. It allows for β¦β11Oct 17, 2025Updated 5 months ago
- Allow the `pm` CLI utility to install APKs from anywhere in your filesystemβ17Mar 30, 2024Updated last year
- β19Jul 15, 2025Updated 8 months ago
- Examples of how to use the Arduino millis() function.β10Apr 11, 2018Updated 7 years ago
- A toolkit to induce interpretable workflows from raw computer-use activities.β41Nov 13, 2025Updated 4 months ago
- Dartive is an ExpressJS-like wrapper for Dart backend, simplifying the process of defining routes and handling HTTP requests.β12Aug 2, 2023Updated 2 years ago
- DeStringCare for extracting Android apk secretsβ15Oct 27, 2020Updated 5 years ago
- SATYA - High Performance Data Validation for Python written in Rustβ21Jan 24, 2026Updated last month
- A tutorial on how to build your own Neural Language Modelβ10Dec 8, 2022Updated 3 years ago
- π€οΈ Pathik - High-Performance Web Crawler β‘β31Mar 27, 2025Updated 11 months ago
- ηΎεΊ¦AIζ―θ΅οΌηΉε»εζ¬Ίθ―ι’ζ΅οΌζε7/424β13Jul 19, 2020Updated 5 years ago
- Persistent memory for AI coding agentsβ41Updated this week
- CrewAI-Agentic-Jira: Enhance your Jira workflows with intelligent agent-driven automation. Powered by the CrewAI framework, this project β¦β22Feb 3, 2025Updated last year
- Magisk module which adds SmartcardService (Open Mobile API 2.05)β12May 17, 2017Updated 8 years ago
- Autotools syntax highlighting for vscode (adapted from Sublime Text)β10Mar 5, 2023Updated 3 years ago
- open-deepsearchβ11Mar 3, 2025Updated last year
- β‘ Bhumi β The fastest AI inference client for Python, built with Rust for unmatched speed, efficiency, and scalability πβ64Jan 22, 2026Updated last month
- Certbot plugin for DNS using Websupport service.β12Jan 8, 2025Updated last year
- The fastest FlashText library for Pythonβ26Jul 4, 2024Updated last year
- Icon themes for FreeCADβ19Nov 6, 2023Updated 2 years ago
- 3000+ machine-readable open source dictionaries distributed by the Applied Computational Linguistics lab at the University of Augsburg, Gβ¦β17Jul 19, 2023Updated 2 years ago
- pyGlobalPlatform is a free open source GlobalPlatform library that can be used to JavaCard and other smartcards. You can use it to write β¦β20Jul 20, 2017Updated 8 years ago
- cortex.llamacpp is a high-efficiency C++ inference engine for edge computing. It is a dynamic library that can be loaded by any server aβ¦β43Jul 4, 2025Updated 8 months ago
- STALE! This used to be a mirror of VPVR @ https://sourceforge.net/p/vpvr merged with 107Final branch @ https://sourceforge.net/u/djrobx/vβ¦β11Oct 23, 2022Updated 3 years ago
- Allows users of FatSecret.com to export their dataβ12Dec 4, 2024Updated last year
- β25Updated this week
- an unstructured data analytics systems via LLMβ24Aug 7, 2025Updated 7 months ago
- Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIAβs TensorRT-LLM for GPU aβ¦β42Sep 26, 2024Updated last year
- Simple image classifier that introduces machine learning with Codespacesβ21Sep 30, 2022Updated 3 years ago
- ANDRAX Hackers Platform.β18Mar 22, 2024Updated last year
- Example Cordova project using https://github.com/trevorpowell/mapbox-gl-js-cordova-offlineβ18Apr 20, 2016Updated 9 years ago
- EvilDroid automates the exploitation of CVE-2024-0044, installing malicious payloads on a target device and extracting sensitive data. Itβ¦β26Sep 6, 2025Updated 6 months ago