π OpenCrawl: An ethical, high-performance web crawler built for scale A powerful web crawling library that respects robots.txt and rate limits while leveraging Kafka for high-throughput data processing. Built with ethics and efficiency in mind.
β27Apr 3, 2025Updated last year
Alternatives and similar repositories for OpenCrawl
Users that are interested in OpenCrawl are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- cortex.llamacpp is a high-efficiency C++ inference engine for edge computing. It is a dynamic library that can be loaded by any server aβ¦β44Jul 4, 2025Updated last year
- Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIAβs TensorRT-LLM for GPU aβ¦β42Sep 26, 2024Updated last year
- open-deepsearchβ11Mar 3, 2025Updated last year
- Train Embedding Models on MLX.β17Jun 2, 2026Updated 2 months ago
- β15Jan 17, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient β’ AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Privacy-first macOS voice assistant powered by on-device AIβ16Jul 15, 2026Updated 3 weeks ago
- A Dockerfile and setup to run lollms-webui in a containerized environmentβ19Sep 4, 2023Updated 2 years ago
- π¦ Turn your idle Mac or GPU into a free public AI API β OpenAI-compatible, one command, zero config (Powered by Llama.cpp)β24Jul 31, 2026Updated last week
- An unofficial mobile client for ComfyUIβ24Oct 14, 2025Updated 9 months ago
- Install dcc plugins with a single Python commandβ24Jun 26, 2025Updated last year
- WaveSpeedAI Python Client β Official Python SDK for WaveSpeedAI inference platform. This library provides a clean, unified, and high-perfβ¦β25Jul 20, 2026Updated 3 weeks ago
- [DEPRECATED] Attempts to convert a Flux lora to a Chroma loraβ20Nov 9, 2025Updated 9 months ago
- β17Apr 29, 2024Updated 2 years ago
- Very small standalone full-text search HTTP/SCGI serverβ15Jun 11, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer β’ AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- qt page routerβ12May 7, 2024Updated 2 years ago
- Cross-platform process dependency monitor with GUIβ12Feb 23, 2026Updated 5 months ago
- Trigram tokenizer module for SQLite FTS5β14Feb 22, 2021Updated 5 years ago
- tools for creating, inspecting and modifying torrent filesβ14Jun 1, 2022Updated 4 years ago
- β24Jul 2, 2025Updated last year
- ιθΏε离ηζΉεΌε ζη«η»β12Dec 15, 2023Updated 2 years ago
- A MCP server that enables AI models to access and search ZIM format knowledge bases offlineβ19Jun 3, 2025Updated last year
- My personal `dotbins`β16Jul 30, 2026Updated last week
- Qt/Qml application using Google speech-to-text API to make voice commandsβ11Jan 19, 2020Updated 6 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Oracle Berkeley DB 18.x (Private copy of official distribution)β11Jul 23, 2020Updated 6 years ago
- Dependency-free and header-only C++11 XGen XPD cache I/O library.β13Jun 23, 2019Updated 7 years ago
- β23Jul 15, 2025Updated last year
- A simple process query/manipulation tool using driver hooked system call. (2019)β11Aug 30, 2021Updated 4 years ago
- pMath is a programming language similar in spirit to Mathematica (symbolic manipulation & pattern matching) which wants to be a full Compβ¦β10Updated this week
- From Doxygen documentation, create a Docset for use in Dash or Zeal.β27Aug 1, 2026Updated last week
- A C++ library for RFC2822 message parsing and creationβ15Aug 29, 2020Updated 5 years ago
- C++ port of the Rust Pathfinder GPU rasterizerβ10Updated this week
- A small cli tool to listen to dark mode changes on macOS Mojaveβ13Jan 18, 2020Updated 6 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A little library for using SIMD instructions for x86 and ARM, wrapping Agner Fog's vectorclass for x86 and filling some of its functionalβ¦β17May 13, 2026Updated 2 months ago
- libsshqt, The libssh Qt Wrapperβ11Nov 3, 2013Updated 12 years ago
- Another character management interface for SillyTavern.β26Jul 16, 2026Updated 3 weeks ago
- Translates WinDbg "dt" structure dump to a C structureβ12Jul 20, 2020Updated 6 years ago
- SeRL: Self-Play Reinforcement Learning for Large Language Models with Limited Dataβ24Jan 24, 2026Updated 6 months ago
- IntelliDisk is an alternative Windows version to the famous Microsoft OneDrive!β15Aug 3, 2026Updated last week
- β28Jul 22, 2026Updated 2 weeks ago