Alternatives and similar repositories for web-scraping-pipeline

Users that are interested in web-scraping-pipeline are comparing it to the libraries listed below

• prrao87 / db-hub-fastapi
  Async bulk data ingestion and querying in various document, graph and vector databases via their Python clients
  ☆37Updated last year
• ArielLahiany / platform
  All Saleor services started from a single repository with Ansible, Terraform, and Kubernetes.
  ☆20Updated 4 years ago
• permitio / permit-python
  Python SDK for Permit.io: Plug & Play Application Level Authorization
  ☆14Updated 4 months ago
• meltano / llm-data-backend-meltano
  ☆11Updated last year
• upwork / python-upwork-oauth2
  Python bindings for Upwork API (OAuth2)
  ☆44Updated 8 months ago
• alwaz-shahid / upwork-jobs-screener
  The Upwork Screener App is a tool for searching and filtering job listings on Upwork. It allows users to easily find jobs that match thei…
  ☆11Updated 2 years ago
• MontFerret / pyfer
  Python wrapper for Ferret
  ☆42Updated 3 years ago
• Dicklesworthstone / youtube_transcript_cleaner
  YouTube Transcript Cleaner is a simple web-based application that improves the readability of YouTube transcripts.
  ☆27Updated 5 months ago
• Norditech-AB / STELLA
  Stella - A scalable platform for creating and managing AI agents
  ☆23Updated last year
• airbytehq / dagster-langchain
  POC integration Airbyte+Dagster+Langchain
  ☆13Updated 2 years ago
• datasette / datasette-write-ui
  A Datasette plugin that adds UI elements to edit, insert, or delete rows in SQLite tables
  ☆21Updated 7 months ago
• yennanliu / web_scraping
  Collect/process data via various data sources : website / js website / API. Run scrapping pipeline via Celery, and Travis cron task. Du…
  ☆13Updated last year
• DerwenAI / textgraphs
  TextGraphs + LLMs + graph ML for entity extraction, linking, ranking, and constructing a lemma graph
  ☆25Updated last year
• geniusrise / geniusrise
  Geniusrise: Framework for building geniuses
  ☆60Updated last year
• MeltanoLabs / tap-google-analytics
  Singer.io Tap for extracting data from the Google Analytics Reporting API
  ☆12Updated 2 weeks ago
• simonw / llm-palm
  Plugin for LLM adding support for Google's PaLM 2 model
  ☆14Updated last year
• SideGuide / hacker-news-tldr
  Powered by SideGuide and GPT-3
  ☆12Updated 2 years ago
• georgeck / SummAIze
  Summarize a URL with GPT-3 Completions
  ☆26Updated last month
• sephib / dagster-graph-project
  Repo demonstrating a Dagster pipeline to generate Neo4j Graph
  ☆22Updated 4 years ago
• anastasiabizyayeva / Etsy_Scraper
  A Selenium webscraper for Etsy that takes search terms and the number of pages you want scraped as inputs, and returns pertinent details …
  ☆27Updated 4 years ago
• harrisonjansma / Medium_Scraper
  The Selenium scraper that collected a million stories from Medium.com
  ☆80Updated 6 years ago
• improve-ai / python-ranker
  Contextual Multi-Armed Bandit Platform for Scoring, Ranking & Decisions
  ☆22Updated 2 years ago
• ssp-data / awesome-dagster
  A curated list of dagster code snippets for data engineers
  ☆57Updated last year
• hightouchio / cli
  Command Line Interface that allows you interact with hightouch resources
  ☆13Updated 3 years ago
• scrapfly / python-scrapfly
  Scrapfly Python SDK for headless browsers and proxy rotation
  ☆47Updated 3 months ago
• DmitryKorzhov / GPT-3_summary
  ☆12Updated last year
• learn-anything / tasks
  Tasks as HTTP endpoints
  ☆27Updated last year
• laffra / Ikke
  Index and search your personal data quickly and privately.
  ☆28Updated 3 years ago
• simonw / datasette-openai
  SQL functions for calling OpenAI APIs
  ☆22Updated 2 years ago
• orchest / orchest-examples
  Awesome Orchest projects, both official and submitted by the community.
  ☆25Updated last year