🌐 OpenCrawl: An ethical, high-performance web crawler built for scale A powerful web crawling library that respects robots.txt and rate limits while leveraging Kafka for high-throughput data processing. Built with ethics and efficiency in mind.
☆27Apr 3, 2025Updated last year
Alternatives and similar repositories for OpenCrawl
Users that are interested in OpenCrawl are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 🛤️ Pathik - High-Performance Web Crawler ⚡☆33Mar 27, 2025Updated last year
- TurboDB — a blazing-fast NoSQL document database written in Zig. mmap + WAL + B-tree + MVCC.☆21May 1, 2026Updated 3 months ago
- ☆16Aug 2, 2026Updated 3 weeks ago
- Rich text editor with AI text generation using TipTap project.☆11Nov 15, 2023Updated 2 years ago
- The core implementation of Feather☆18Jan 19, 2026Updated 7 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Ernie-AI-Windows is an innovative artificial intelligence software tailored specifically for Windows operating systems, delivering cuttin…☆55Apr 5, 2024Updated 2 years ago
- Live commentary for your code☆16Apr 6, 2026Updated 4 months ago
- Dartive is an ExpressJS-like wrapper for Dart backend, simplifying the process of defining routes and handling HTTP requests.☆12Aug 2, 2023Updated 3 years ago
- open-deepsearch☆12Mar 3, 2025Updated last year
- ☆160Apr 17, 2025Updated last year
- ☆15Jul 3, 2025Updated last year
- Welcome to Kokoro, a high-quality text-to-speech synthesis program powered by deep learning. This tool converts any text into high-fideli…☆15Jan 5, 2026Updated 7 months ago
- Standalone, local-runnable binaries of popular linux distributions☆10Dec 15, 2021Updated 4 years ago
- Prompts for creating SillyTavern presets with AI - from basic parameters to 60+ module mega-presets☆26Nov 9, 2025Updated 9 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Privacy-first macOS voice assistant powered by on-device AI☆16Jul 15, 2026Updated last month
- Infrastructure useful to create natural language processing systems based on transformer networks☆12Sep 26, 2019Updated 6 years ago
- ☆28Apr 13, 2025Updated last year
- This repository contains detailed introduction to Langgraph, a new Langchain library. You will learn about langgraph and also create a mi…☆18May 27, 2024Updated 2 years ago
- ☆10Apr 19, 2026Updated 4 months ago
- A UI designer for constructing AI applications with OpenSearch☆16Updated this week
- Official Python SDK for WaveSpeed — image, video, audio and 3D generation via the wavespeed.ai API☆24Updated this week
- A beautiful desktop application for Local-NotebookLM that provides an intuitive UI for converting PDFs to engaging audio content.☆23Apr 1, 2026Updated 4 months ago
- A plugin to encrypt Opensearch data at rest (on linux distributions). A key can be defined for each index level granularity and data at r…☆15Aug 6, 2026Updated 3 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆17Apr 29, 2024Updated 2 years ago
- Code for "Time-Aware Auto White Balance in Mobile Photography"☆34Jan 25, 2026Updated 7 months ago
- Official code for "How2Everything: Mining the Web for How-To Procedures to Evaluate and Improve LLMs"☆25Feb 10, 2026Updated 6 months ago
- Very small standalone full-text search HTTP/SCGI server☆15Jun 11, 2025Updated last year
- ☆15May 28, 2025Updated last year
- qt page router☆12May 7, 2024Updated 2 years ago
- Cross-platform process dependency monitor with GUI☆12Feb 23, 2026Updated 6 months ago
- GSM 06.10 lossy speech compression from http://quut.com/gsm/☆24Mar 24, 2018Updated 8 years ago
- My personal `dotbins`☆16Jul 30, 2026Updated last month
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Qt/Qml application using Google speech-to-text API to make voice commands☆11Jan 19, 2020Updated 6 years ago
- Dependency-free and header-only C++11 XGen XPD cache I/O library.☆13Jun 23, 2019Updated 7 years ago
- Mirror of git://git.code.sf.net/p/libwpd/librevenge☆13Feb 2, 2016Updated 10 years ago
- ☆23Jul 15, 2025Updated last year
- 📖 Convert a yaml file to bib file with the correct journal abbreviations.☆17Aug 24, 2026Updated last week
- Search Relevance Workbench for OpenSearch.☆15Aug 24, 2026Updated last week
- API specification for OpenSearch☆62Aug 21, 2026Updated last week