Alternatives and similar repositories for scaling-to-distributed-crawling

Users that are interested in scaling-to-distributed-crawling are comparing it to the libraries listed below

• Rsweater / Awesome-Lane-Detection

  View on GitHub
  This repository contains content related to 2D and 3D lane detection, as well as video lane detection. There are not only papers here, bu…
  ☆13Sep 1, 2024Updated last year
• mattia-decao / hiero-transformer

  View on GitHub
  ☆12Nov 3, 2024Updated last year
• jdechalendar / why100renewable-suppl

  View on GitHub
  Supplemental code and data for the paper: Turning the spotlight on California’s (dirty) nighttime emissions
  ☆10May 3, 2019Updated 6 years ago
• masakhane-io / africomet

  View on GitHub
  COMET for African languages
  ☆10Jan 24, 2025Updated last year
• suralmasha / RuTranscript

  View on GitHub
  Russian phonetical transcription
  ☆11Nov 19, 2025Updated 2 months ago
• tuva-health / medicare_lds_connector

  View on GitHub
  Maps Medicare LDS claims data to the Tuva Input Layer so you can easily run the Tuva Project.
  ☆11Dec 15, 2025Updated 2 months ago
• Eric-exe / Market-Sentiment

  View on GitHub
  A website showing several companies' stocks and their market sentiments using Yahooquery and Marketaux API.
  ☆13Jan 18, 2024Updated 2 years ago
• Lumen-Labs / cpp-chunker

  View on GitHub
  Implementation of a fast semantic chunker in C++, installable in python 3.7+ projects.
  ☆22Sep 20, 2025Updated 4 months ago
• TUDB-Labs / TuDB

  View on GitHub
  A distributed graph database system (GDBMS)
  ☆11Feb 20, 2023Updated 2 years ago
• jiani-huang / RecBenchPlus

  View on GitHub
  Benchmark dataset for the paper "Towards Next-Generation Recommender Systems: A Benchmark for Personalized Recommendation Assistant with …
  ☆23May 20, 2025Updated 8 months ago
• nasa / gesdisc-cloud-tutorials

  View on GitHub
  ☆11Jun 13, 2024Updated last year
• HIRO-MicroDataCenters-BV / rhio

  View on GitHub
  Peer-to-peer NATS message routing and S3 object sync solution
  ☆18Feb 5, 2026Updated last week
• tylersavery / djawesome

  View on GitHub
  Django with Vagrant and Chef Boilerplate
  ☆11Apr 21, 2023Updated 2 years ago
• BJ1209 / Telegram-clone

  View on GitHub
  Telegram Clone with react/redux and firebase
  ☆10Dec 10, 2020Updated 5 years ago
• paultag / go-dictd

  View on GitHub
  dictd server bindings in go
  ☆10Oct 1, 2016Updated 9 years ago
• uniwue-zpd / PAGETools

  View on GitHub
  Small collection of PAGE XML related scripts used at the ZPD Würzburg
  ☆12Aug 2, 2024Updated last year
• Saluana / EZAI-Web-Scraper

  View on GitHub
  An API that allows you to scrape blog posts and articles and get a list of notes or a summary back.
  ☆10Mar 31, 2023Updated 2 years ago
• spikelantern / simple-infinite-scroll

  View on GitHub
  Simple infinite scroll using Django
  ☆10Jul 26, 2020Updated 5 years ago
• tuva-health / medicare_cclf_connector

  View on GitHub
  This connector is a dbt project that maps Medicare CCLF claims data to the Tuva Input Layer.
  ☆14Jan 31, 2026Updated 2 weeks ago
• zorkow / MaxTract

  View on GitHub
  Old implementation of the MaxTract system for re-engineering mathematical PDF documents.
  ☆12Jan 25, 2016Updated 10 years ago
• deepvk / muse

  View on GitHub
  🎵 muse: Music Separation
  ☆11Feb 14, 2024Updated 2 years ago
• UCL / simstock

  View on GitHub
  Python library for generating EnergyPlus inputs
  ☆11Updated this week
• freesunshine0316 / sembleu

  View on GitHub
  SemBleu: A Robust Metric for AMR Parsing Evaluation
  ☆12Feb 22, 2021Updated 4 years ago
• weljoan / qdlink-android

  View on GitHub
  ☆11Mar 24, 2021Updated 4 years ago
• dabapps / django-rest-framework-serialization-spec

  View on GitHub
  DEPRECATED, see https://github.com/dabapps/django-readers instead
  ☆11Apr 22, 2022Updated 3 years ago
• pinecone-io / VSB

  View on GitHub
  Vector Search Benchmarking suite
  ☆12Feb 8, 2026Updated last week
• dinoperovic / django-salesman-stripe

  View on GitHub
  Stripe payment integration for Salesman.
  ☆12Feb 23, 2023Updated 2 years ago
• kylegallatin / components-of-an-ml-system

  View on GitHub
  ☆11Dec 30, 2022Updated 3 years ago
• anirudhsudhir / snoopy

  View on GitHub
  A VPN written in Rust
  ☆13Apr 17, 2025Updated 9 months ago
• SapienzaNLP / conception

  View on GitHub
  Code and experiments for the COLING2020 paper "Conception: Multilingually-Enhanced, Human-Readable Concept Vector Representations".
  ☆11Dec 9, 2020Updated 5 years ago
• aragalie / FX_NaiveChartPredictions_using_fastai

  View on GitHub
  Predictions of long/short positions for FX trading done using state-of-the-art image recognition algorithms
  ☆15Mar 29, 2018Updated 7 years ago
• IlyaGusev / TaleStudio

  View on GitHub
  Fork of RecurrentGPT with modifications
  ☆10Sep 18, 2024Updated last year
• KillrVideo / killrvideo-web

  View on GitHub
  The web server and browser single page app for KillrVideo
  ☆11Sep 15, 2022Updated 3 years ago
• neuml / ttstokenizer

  View on GitHub
  Tokenizer for Text to Speech (TTS) models
  ☆13Jan 16, 2025Updated last year
• jottenlips / rust-rocket-ecs

  View on GitHub
  🦀 Rust server running in a Docker container deployed to AWS ECS via Terraform 🚀
  ☆12Dec 31, 2024Updated last year
• adsharma / kuzu-demo-dspy

  View on GitHub
  Demo of knowledge graph creation and Graph RAG with Dspy and Kuzu
  ☆22Jun 30, 2025Updated 7 months ago
• kmicinski / security-courses

  View on GitHub
  A list of security courses at colleges and universities
  ☆12Aug 9, 2017Updated 8 years ago
• ninjabit / react-django-oauth2-example

  View on GitHub
  An example oauth integration with reactjs frontend and a django backend with google and github login
  ☆10Apr 28, 2018Updated 7 years ago
• stas00 / python-tools

  View on GitHub
  Python tools
  ☆14Oct 22, 2023Updated 2 years ago