Alternatives and similar repositories for web-scraping-pipeline

Users that are interested in web-scraping-pipeline are comparing it to the libraries listed below

• prrao87 / db-hub-fastapi
  Async bulk data ingestion and querying in various document, graph and vector databases via their Python clients
  ☆39Updated last year
• ArielLahiany / platform
  All Saleor services started from a single repository with Ansible, Terraform, and Kubernetes.
  ☆21Updated 4 years ago
• meltano / llm-data-backend-meltano
  ☆11Updated 2 years ago
• jimmc414 / document_intelligence
  Automated Document Intelligence Workflow
  ☆28Updated 9 months ago
• Dicklesworthstone / youtube_transcript_cleaner
  YouTube Transcript Cleaner is a simple web-based application that improves the readability of YouTube transcripts.
  ☆26Updated 7 months ago
• meltano / squared
  Where the Meltano team runs Meltano! Get it???
  ☆28Updated 6 months ago
• fivetran / dbt_hubspot_source
  Data models for Hubspot built using dbt.
  ☆41Updated last week
• AntonOvsyannikov / pure-teleapi
  Pure declarative Telegram Bot API implementation with Pydantic models and Protocol-inherited API definitions (both sync and async) with n…
  ☆16Updated 7 months ago
• repollo / llm_data_parser
  This is a proof-of-concept of using an LLM to find and extract meaningful data without parsing the html too much.
  ☆30Updated 2 years ago
• nialloriordan / airbyte-airflow-scraper
  Pipeline to scrape data from Linkedin using Airbyte and Airflow
  ☆29Updated 3 years ago
• MontFerret / pyfer
  Python wrapper for Ferret
  ☆43Updated 3 years ago
• datasette / datasette-write-ui
  A Datasette plugin that adds UI elements to edit, insert, or delete rows in SQLite tables
  ☆21Updated last month
• learn-co-curriculum / dsc-pandas-data-cleaning-lab
  ☆28Updated last year
• simonw / llm-palm
  Plugin for LLM adding support for Google's PaLM 2 model
  ☆14Updated 2 years ago
• Socvest / streamlit-local-storage
  Manage local storage of browser for streamlit apps
  ☆13Updated 9 months ago
• go-go-golems / geppetto
  golang GPT3 tooling
  ☆83Updated this week
• harrisonjansma / Medium_Scraper
  The Selenium scraper that collected a million stories from Medium.com
  ☆80Updated 6 years ago
• namuan / animate-puml
  Simple animation for PlantUML diagrams
  ☆16Updated last year
• sephib / dagster-graph-project
  Repo demonstrating a Dagster pipeline to generate Neo4j Graph
  ☆22Updated 4 years ago
• ThoughtWorksInc / ml-cd-starter-kit
  Set up cross-cutting services (e.g. CI server, monitoring) for ML projects using kubernetes and helm
  ☆22Updated 6 years ago
• 5uru / Median
  Median is an open-source flashcard application that leverages the power of spaced repetition and artificial intelligence to transform the…
  ☆22Updated 11 months ago
• neo4j-documentation / knowledge-base
  Public Neo4j Knowledge Base
  ☆23Updated 2 months ago
• atilatech / awesome-longevity
  An awesome list of longevity resources for living longer, healthier lives.
  ☆34Updated 2 years ago
• airbytehq / dagster-langchain
  POC integration Airbyte+Dagster+Langchain
  ☆13Updated 2 years ago
• cloudhut / owl-shop
  ☆39Updated last year
• simonw / scrape-fediverse
  Git scrapers for scraping the fediverse
  ☆16Updated this week
• quantile-development / dagster-meltano
  A Dagster plugin that allows you to run Meltano in Dagster
  ☆49Updated 11 months ago
• flywhl / cyantic
  Build complex types from simple blueprints with Pydantic
  ☆26Updated 6 months ago
• MeltanoLabs / tap-google-analytics
  Singer.io Tap for extracting data from the Google Analytics Reporting API
  ☆12Updated this week
• fivetran / dbt_salesforce_source
  Fivetran's Salesforce source dbt package
  ☆13Updated last week