π OpenCrawl: An ethical, high-performance web crawler built for scale A powerful web crawling library that respects robots.txt and rate limits while leveraging Kafka for high-throughput data processing. Built with ethics and efficiency in mind.
β28Apr 3, 2025Updated last year
Alternatives and similar repositories for OpenCrawl
Users that are interested in OpenCrawl are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- DHI: High-Performance, WebAssembly-Powered TypeScript Validatorβ14Sep 2, 2025Updated last year
- π€οΈ Pathik - High-Performance Web Crawler β‘β33Mar 27, 2025Updated last year
- TurboDB β a blazing-fast NoSQL document database written in Zig. mmap + WAL + B-tree + MVCC.β22May 1, 2026Updated 4 months ago
- Ernie-AI-Windows is an innovative artificial intelligence software tailored specifically for Windows operating systems, delivering cuttinβ¦β55Apr 5, 2024Updated 2 years ago
- Code for "Time-Aware Auto White Balance in Mobile Photography" (ICCV 2025)β19Jul 6, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI β’ AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- β160Apr 17, 2025Updated last year
- β15Jul 3, 2025Updated last year
- Public results and task definitions for FrontierHarness Evalβ261Sep 8, 2026Updated last week
- β‘ Bhumi β The fastest AI inference client for Python, built with Rust for unmatched speed, efficiency, and scalability πβ68Jan 22, 2026Updated 7 months ago
- Welcome to Kokoro, a high-quality text-to-speech synthesis program powered by deep learning. This tool converts any text into high-fideliβ¦β15Jan 5, 2026Updated 8 months ago
- Simple Flutter Architecture Guidelineβ16Jul 24, 2021Updated 5 years ago
- Standalone, local-runnable binaries of popular linux distributionsβ10Dec 15, 2021Updated 4 years ago
- A Dockerfile and setup to run lollms-webui in a containerized environmentβ19Sep 4, 2023Updated 3 years ago
- A convenient way to write text and track versions.β13Feb 15, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available β’ AdRun AI, ML, and HPC workloads on powerful cloud GPUsβwithout limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Prompts for creating SillyTavern presets with AI - from basic parameters to 60+ module mega-presetsβ29Nov 9, 2025Updated 10 months ago
- A UI designer for constructing AI applications with OpenSearchβ17Updated this week
- Install dcc plugins with a single Python commandβ24Jun 26, 2025Updated last year
- Official Python SDK for WaveSpeed β image, video, audio and 3D generation via the wavespeed.ai APIβ28Updated this week
- [DEPRECATED] Attempts to convert a Flux lora to a Chroma loraβ20Nov 9, 2025Updated 10 months ago
- An offline CPU-first low-resource chat application to perform RAG on your corpus of data. Powered by OpenChat and CTranslate2.β15Sep 12, 2026Updated last week
- A beautiful desktop application for Local-NotebookLM that provides an intuitive UI for converting PDFs to engaging audio content.β28Apr 1, 2026Updated 5 months ago
- β17Apr 29, 2024Updated 2 years ago
- Utilize Autonomous AI Agents in a Project Management Office (PMO)β33Apr 24, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient β’ AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Official code for "How2Everything: Mining the Web for How-To Procedures to Evaluate and Improve LLMs"β25Feb 10, 2026Updated 7 months ago
- Very small standalone full-text search HTTP/SCGI serverβ15Jun 11, 2025Updated last year
- β15May 28, 2025Updated last year
- Library for Object Linking and Embedding (OLE) data typesβ13Updated this week
- A repository of Python & PyTorch scripts which (currently) converts .safetensors models into scaled FP8 variants, utilizing gradient descβ¦β26Aug 8, 2025Updated last year
- ιθΏε离ηζΉεΌε ζη«η»β12Dec 15, 2023Updated 2 years ago
- Skill file for MLX-Swift-LMβ24Feb 24, 2026Updated 6 months ago
- Qt/Qml application using Google speech-to-text API to make voice commandsβ11Jan 19, 2020Updated 6 years ago
- 10 years after the downfall of the TRiAS GmbH in Germany it's definitely time to release the sources of the TRiAS Spatial Information Sysβ¦β11Nov 11, 2012Updated 13 years ago
- Deploy on Railway without the complexity - Free Credits Offer β’ AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Mirror of git://git.code.sf.net/p/libwpd/librevengeβ13Feb 2, 2016Updated 10 years ago
- An invisible AI assistant for Linux that responds to your key combos, bringing thoughts to life β one keystroke at a time.β19Jun 27, 2025Updated last year
- Search Relevance Workbench for OpenSearch.β15Updated this week
- A simple process query/manipulation tool using driver hooked system call. (2019)β11Aug 30, 2021Updated 5 years ago
- pMath is a programming language similar in spirit to Mathematica (symbolic manipulation & pattern matching) which wants to be a full Compβ¦β10Sep 8, 2026Updated last week
- Python module to interact with THOR Thunderstorm serviceβ18Dec 5, 2025Updated 9 months ago
- CrewAI-Agentic-Jira: Enhance your Jira workflows with intelligent agent-driven automation. Powered by the CrewAI framework, this project β¦β23Feb 3, 2025Updated last year