π OpenCrawl: An ethical, high-performance web crawler built for scale A powerful web crawling library that respects robots.txt and rate limits while leveraging Kafka for high-throughput data processing. Built with ethics and efficiency in mind.
β25Apr 3, 2025Updated last year
Alternatives and similar repositories for OpenCrawl
Users that are interested in OpenCrawl are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- π€οΈ Pathik - High-Performance Web Crawler β‘β33Mar 27, 2025Updated last year
- Ernie-AI-Windows is an innovative artificial intelligence software tailored specifically for Windows operating systems, delivering cuttinβ¦β55Apr 5, 2024Updated 2 years ago
- Live commentary for your codeβ16Apr 6, 2026Updated 3 months ago
- Elephantasm is a framework for persistent, long-term agentic memory - built to give AI systems continuity, self-reflection, and evolving β¦β16Mar 18, 2026Updated 4 months ago
- Gradio UI to load crewAI configuration from excel xls and generate the python code. The source of the crews is in the xls. It allows for β¦β10Oct 17, 2025Updated 9 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIAβs TensorRT-LLM for GPU aβ¦β42Sep 26, 2024Updated last year
- open-deepsearchβ11Mar 3, 2025Updated last year
- β15Jul 3, 2025Updated last year
- Welcome to Kokoro, a high-quality text-to-speech synthesis program powered by deep learning. This tool converts any text into high-fideliβ¦β15Jan 5, 2026Updated 6 months ago
- Simple Flutter Architecture Guidelineβ17Jul 24, 2021Updated 4 years ago
- Standalone, local-runnable binaries of popular linux distributionsβ10Dec 15, 2021Updated 4 years ago
- Prompts for creating SillyTavern presets with AI - from basic parameters to 60+ module mega-presetsβ19Nov 9, 2025Updated 8 months ago
- Run multiple-node, decentralized k3s clusters on Github action runners for test and development!β10Nov 20, 2021Updated 4 years ago
- A Dockerfile and setup to run lollms-webui in a containerized environmentβ19Sep 4, 2023Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer β’ AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A convenient way to write text and track versions.β13Feb 15, 2025Updated last year
- An unofficial mobile client for ComfyUIβ23Oct 14, 2025Updated 9 months ago
- LlamaNet: Decentralized Inference Swarm for llama.cppβ23Jun 19, 2026Updated last month
- This repository contains detailed introduction to Langgraph, a new Langchain library. You will learn about langgraph and also create a miβ¦β18May 27, 2024Updated 2 years ago
- β10Apr 19, 2026Updated 3 months ago
- A UI designer for constructing AI applications with OpenSearchβ16Updated this week
- WaveSpeedAI Python Client β Official Python SDK for WaveSpeedAI inference platform. This library provides a clean, unified, and high-perfβ¦β23Updated this week
- A beautiful desktop application for Local-NotebookLM that provides an intuitive UI for converting PDFs to engaging audio content.β15Apr 1, 2026Updated 3 months ago
- [DEPRECATED] Attempts to convert a Flux lora to a Chroma loraβ21Nov 9, 2025Updated 8 months ago
- Managed hosting for WordPress and PHP on Cloudways β’ AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A plugin to encrypt Opensearch data at rest (on linux distributions). A key can be defined for each index level granularity and data at rβ¦β15Jul 9, 2026Updated last week
- An offline CPU-first low-resource chat application to perform RAG on your corpus of data. Powered by OpenChat and CTranslate2.β15May 14, 2025Updated last year
- β17Apr 29, 2024Updated 2 years ago
- Code for "Time-Aware Auto White Balance in Mobile Photography"β31Jan 25, 2026Updated 5 months ago
- Official code for "How2Everything: Mining the Web for How-To Procedures to Evaluate and Improve LLMs"β24Feb 10, 2026Updated 5 months ago
- A repository of Python & PyTorch scripts which (currently) converts .safetensors models into scaled FP8 variants, utilizing gradient descβ¦β26Aug 8, 2025Updated 11 months ago
- Very small standalone full-text search HTTP/SCGI serverβ15Jun 11, 2025Updated last year
- β15May 28, 2025Updated last year
- Cross-platform process dependency monitor with GUIβ12Feb 23, 2026Updated 4 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- β22Jul 2, 2025Updated last year
- Trigram tokenizer module for SQLite FTS5β14Feb 22, 2021Updated 5 years ago
- ιθΏε离ηζΉεΌε ζη«η»β12Dec 15, 2023Updated 2 years ago
- Skill file for MLX-Swift-LMβ24Feb 24, 2026Updated 4 months ago
- My personal `dotbins`β16Updated this week
- Qt/Qml application using Google speech-to-text API to make voice commandsβ11Jan 19, 2020Updated 6 years ago
- Oracle Berkeley DB 18.x (Private copy of official distribution)β11Jul 23, 2020Updated 5 years ago