Alternatives and similar repositories for web-scraping-pipeline

Users that are interested in web-scraping-pipeline are comparing it to the libraries listed below

• prrao87 / db-hub-fastapi
  Async bulk data ingestion and querying in various document, graph and vector databases via their Python clients
  ☆40Updated 2 years ago
• ArielLahiany / platform
  All Saleor services started from a single repository with Ansible, Terraform, and Kubernetes.
  ☆21Updated 4 years ago
• upwork / python-upwork-oauth2
  Python bindings for Upwork API (OAuth2)
  ☆44Updated last year
• repollo / llm_data_parser
  This is a proof-of-concept of using an LLM to find and extract meaningful data without parsing the html too much.
  ☆30Updated 2 years ago
• meltano / llm-data-backend-meltano
  ☆11Updated 2 years ago
• airbytehq / dagster-langchain
  POC integration Airbyte+Dagster+Langchain
  ☆13Updated 2 years ago
• flywhl / cyantic
  Build complex types from simple blueprints with Pydantic
  ☆26Updated 2 months ago
• harrisonjansma / Medium_Scraper
  The Selenium scraper that collected a million stories from Medium.com
  ☆81Updated 7 years ago
• neo4j-documentation / knowledge-base
  Public Neo4j Knowledge Base
  ☆24Updated 4 months ago
• scrapfly / python-scrapfly
  Scrapfly Python SDK for headless browsers and proxy rotation
  ☆49Updated 3 weeks ago
• DerwenAI / textgraphs
  TextGraphs + LLMs + graph ML for entity extraction, linking, ranking, and constructing a lemma graph
  ☆25Updated last year
• petracarrion / job-market-analytics
  ☆12Updated 2 years ago
• MontFerret / pyfer
  Python wrapper for Ferret
  ☆45Updated 3 years ago
• paysure / orinoco
  Functional composable pipelines allowing clean separation of the business logic and its implementation
  ☆11Updated 3 months ago
• go-go-golems / geppetto
  golang GPT3 tooling
  ☆83Updated last week
• smaurice101 / transactionalmachinelearning
  Transactional Machine Learning using Data Streams and AutoML
  ☆14Updated 2 months ago
• simonw / datasette-publish-vercel
  Datasette plugin for publishing data using Vercel
  ☆46Updated 3 years ago
• bcongdon / bolero
  Construct your personal API
  ☆18Updated 3 years ago
• dapensoft / pyorlib
  A powerful Python library for operations research and optimization.
  ☆21Updated 4 months ago
• Dicklesworthstone / youtube_transcript_cleaner
  YouTube Transcript Cleaner is a simple web-based application that improves the readability of YouTube transcripts.
  ☆26Updated 9 months ago
• sephib / dagster-graph-project
  Repo demonstrating a Dagster pipeline to generate Neo4j Graph
  ☆22Updated 4 years ago
• kornicameister / loguru-mypy
  mypy plugin for loguru
  ☆22Updated last year
• sourcery-ai / sourcery-rules
  ☆12Updated 2 years ago
• rasnes / stock-advisor
  Stock Advisor
  ☆11Updated 6 months ago
• nialloriordan / airbyte-airflow-scraper
  Pipeline to scrape data from Linkedin using Airbyte and Airflow
  ☆29Updated 3 years ago
• infinyon / stateful-dataflow-examples
  Stateful Dataflows tutorials and examples.
  ☆40Updated 5 months ago
• 5uru / Median
  Median is an open-source flashcard application that leverages the power of spaced repetition and artificial intelligence to transform the…
  ☆22Updated last year
• jason810496 / pgmq-sqlalchemy
  More flexible PGMQ Postgres extension Python client that using SQLAlchemy ORM, supporting both async and sync engines, sessionmakers or b…
  ☆24Updated last month
• datasette / datasette-write-ui
  A Datasette plugin that adds UI elements to edit, insert, or delete rows in SQLite tables
  ☆22Updated last month
• Aiven-Labs / python-fake-data-producer-for-apache-kafka
  The Python fake data producer for Apache Kafka® is a complete demo app allowing you to quickly produce JSON fake streaming datasets and …
  ☆85Updated last year