Alternatives and similar repositories for web-scraping-pipeline:

Users that are interested in web-scraping-pipeline are comparing it to the libraries listed below

• prrao87 / db-hub-fastapi
  Async bulk data ingestion and querying in various document, graph and vector databases via their Python clients
  ☆36Updated last year
• paysure / orinoco
  Functional composable pipelines allowing clean separation of the business logic and its implementation
  ☆11Updated 8 months ago
• Dicklesworthstone / youtube_transcript_cleaner
  YouTube Transcript Cleaner is a simple web-based application that improves the readability of YouTube transcripts.
  ☆25Updated last year
• orchest / orchest-examples
  Awesome Orchest projects, both official and submitted by the community.
  ☆25Updated last year
• mcminis1 / mr-graph
  a graph definition and execution library for python
  ☆16Updated last year
• ashen007 / LiteratureReview
  scrapper for various science databases
  ☆11Updated last year
• kyegomez / dev-swarm
  A swarm of LLM agents that will help you test, document, and productionize your code!
  ☆13Updated last week
• simonw / llm-palm
  Plugin for LLM adding support for Google's PaLM 2 model
  ☆14Updated last year
• seeM / Jim
  Jim is a simple, beautiful Jupyter notebook editor for macOS
  ☆29Updated last year
• SsebowaDisan / ssebowa
  Ssebowa is free and open source library in Python that provides generative-ai models.
  ☆14Updated last year
• levrofin / toolhub
  A collection of tools that can be used for LLM function calling
  ☆32Updated 11 months ago
• data-describe / awesome-data-science-models
  A few end to end examples that use data-describe
  ☆16Updated last year
• chawlasahaj / dsiprojects
  A collection of projects I did while at General Assembly Singapore - as part of Data Science Immersive
  ☆11Updated 4 years ago
• MantisAI / prompt_engineering
  Code that accompanies the PyData New York (2022) talk: Addressing the sensitivity of Large language models
  ☆13Updated 2 years ago
• PrefectHQ / prefect-openai
  Prefect integrations for working with OpenAI.
  ☆36Updated 9 months ago
• kbastani / russian-troll-analysis
  This repository auto-configures an Apache Pinot and Superset cluster for analyzing IRA tweets from FiveThirtyEight.
  ☆11Updated 4 years ago
• awesome-mlops / awesome-data-management
  A curated list of awesome open source tools and commercial products to catalog, version, and manage data 🚀
  ☆30Updated 2 years ago
• logicalpath / photomanage
  Scripts and ideas to manage tons and tons of images and movies
  ☆16Updated last week
• ngshiheng / burplist
  Web crawler for Burplist, a search engine for craft beers in Singapore
  ☆14Updated this week
• rclement / datasette-ml
  A Datasette plugin providing an MLOps platform to train, eval and predict machine learning models
  ☆15Updated this week
• dennisbakhuis / tqdm_batch
  Batch processing using joblib including tqdm progress bars
  ☆20Updated 3 years ago
• outerbounds / nbdoc
  Generate beautiful, testable documentation with Jupyter Notebooks
  ☆21Updated 2 years ago
• brendanhasz / dagio
  A python package for running directed acyclic graphs of asynchronous I/O operations
  ☆16Updated 3 years ago
• minimaxir / ai-generated-magic-cards
  Tools for encoding Magic: The Gathering cards into a form suitable for AI text generation
  ☆19Updated 3 years ago
• koaning / uvnb
  Have UV deal with all your Jupyter deps.
  ☆22Updated 5 months ago
• simonw / datasette-faiss
  Maintain a FAISS index for specified Datasette tables
  ☆35Updated 8 months ago
• simonw / datasette-openai
  SQL functions for calling OpenAI APIs
  ☆21Updated 2 years ago
• flywhl / cyantic
  Build complex types from simple blueprints with Pydantic
  ☆24Updated last month
• dblock / vectordb-hello-world
  Examples of vector DB indexing and query with various vector databases.
  ☆12Updated last week