🌐 OpenCrawl: An ethical, high-performance web crawler built for scale A powerful web crawling library that respects robots.txt and rate limits while leveraging Kafka for high-throughput data processing. Built with ethics and efficiency in mind.
☆28Apr 3, 2025Updated last year
Alternatives and similar repositories for OpenCrawl
Users that are interested in OpenCrawl are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Self-supervised representation learning for CAD model☆12May 7, 2025Updated last year
- deprecated: C++ sanctuary for small but powerful and frequently required, stand alone features.☆16Jan 24, 2018Updated 8 years ago
- ☆14Nov 27, 2025Updated 11 months ago
- An open source deep research clone. AI Agent (Local LLM or Gemini) that reasons large amounts of web data extracted with SwiftSoup.☆14Feb 10, 2025Updated last year
- Automatically enables TensorFloat-32 (TF32) acceleration for NVIDIA RTX 30/40/50 series GPUs in ComfyUI.☆12Mar 10, 2026Updated 7 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- This is a Node.js Hello World example plugin☆12Feb 22, 2023Updated 3 years ago
- Ernie-AI-Windows is an innovative artificial intelligence software tailored specifically for Windows operating systems, delivering cuttin…☆56Apr 5, 2024Updated 2 years ago
- A dotnet-new template to start off plugins for the Flow Launcher.☆12Mar 25, 2026Updated 7 months ago
- ☆11May 28, 2023Updated 3 years ago
- [CVPR 2026] Official PyTorch Implementation of "AutoRegressive Generation with B-rep Holistic Token Sequence Representation".☆25Jul 7, 2026Updated 3 months ago
- WIP Automation using CrewAi and LangGraph to sort, analyze and report on complaint emails☆11May 29, 2024Updated 2 years ago
- Open product release note registry, indexed and made for agents. Get recent product changelogs via MCP + CLI.☆13Updated this week
- 📂 Hexdumper - colored, modern, lightweight, without dependencies!☆12Apr 20, 2026Updated 6 months ago
- Write your own custom, context-aware FFXIV chat commands in lua!☆12May 21, 2026Updated 5 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- [ICLR 2026] Monitoring Decomposition Attacks with Lightweight Sequential Monitors☆12Apr 20, 2026Updated 6 months ago
- A curated list of tokenizer libraries for blazing-fast NLP processing.☆14Apr 10, 2025Updated last year
- RSS Crawler MCP Server☆19Mar 31, 2025Updated last year
- Export up to 500,000 rows from the Google Search Console API. Free bulk export tool that bypasses the GSC 1,000-row limit, with filters, …☆12Jun 19, 2026Updated 4 months ago
- Certego components library. Built on React.js + reactstrap + more.☆12Mar 25, 2026Updated 7 months ago
- ☆15Jul 3, 2025Updated last year
- No longer maintained. Timing attacks on a browsers cache to try to predict websites/subreddits that have been viewed☆13Sep 25, 2026Updated last month
- ☆15Jan 17, 2025Updated last year
- macOS menu bar remote for Google TV and Android TV devices with local discovery, one-time pairing, keyboard controls, and text input.☆17Updated this week
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Local, cache-aware LLM usage and cost telemetry for OpenClaw.☆15Jul 27, 2026Updated 3 months ago
- Compiles world maps from World of Warcraft into single images☆15Oct 19, 2026Updated 2 weeks ago
- Run multiple-node, decentralized k3s clusters on Github action runners for test and development!☆10Nov 20, 2021Updated 4 years ago
- ☆10Sep 11, 2026Updated last month
- This repository contains detailed introduction to Langgraph, a new Langchain library. You will learn about langgraph and also create a mi…☆18May 27, 2024Updated 2 years ago
- A tool to bechmark soilidity smart contracts and snippets☆17Mar 1, 2020Updated 6 years ago
- See the full execution path for a given transaction, both cross contract and within a single contract.☆16Mar 10, 2019Updated 7 years ago
- Clean your Derived Data, Clean build folder, Reset Packages Cache, and resolve package version from your menu bar with global keyboard sh…☆19Apr 5, 2026Updated 6 months ago
- SYM-Lite is a lean, purpose-built script for executing MDM-agnostic Installomator labels — and / or Jamf Pro-specific policy triggers — a…☆16Oct 10, 2026Updated 3 weeks ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Enable Falco to read audit logs from EKS☆11Dec 13, 2020Updated 5 years ago
- One-click install for WizardLM-13B-Uncensored with oobabooga webui☆21Jun 27, 2023Updated 3 years ago
- Tool to start a python http server in a simple way☆11Mar 30, 2022Updated 4 years ago
- Capgo landing website + documentation☆12Updated this week
- desktop GUI for GPT4. written in PyQt6. It features syntax highlighting, history, and long-term memory.☆14Oct 21, 2024Updated 2 years ago
- Official code for "How2Everything: Mining the Web for How-To Procedures to Evaluate and Improve LLMs"☆25Feb 10, 2026Updated 8 months ago
- Parse lodestone for those juicy details☆13May 19, 2024Updated 2 years ago