Alternatives and similar repositories for web-scraping-pipeline

Users that are interested in web-scraping-pipeline are comparing it to the libraries listed below

• prrao87 / db-hub-fastapi
  Async bulk data ingestion and querying in various document, graph and vector databases via their Python clients
  ☆36Updated last year
• dbpedia / ontology-time-machine
  ☆11Updated 4 months ago
• orchest / orchest-examples
  Awesome Orchest projects, both official and submitted by the community.
  ☆25Updated last year
• Dicklesworthstone / youtube_transcript_cleaner
  YouTube Transcript Cleaner is a simple web-based application that improves the readability of YouTube transcripts.
  ☆26Updated 3 months ago
• rclement / datasette-ml
  A Datasette plugin providing an MLOps platform to train, eval and predict machine learning models
  ☆16Updated last week
• simonw / datasette-seaborn
  Statistical visualizations for Datasette using Seaborn
  ☆12Updated 3 years ago
• dblock / vectordb-hello-world
  Examples of vector DB indexing and query with various vector databases.
  ☆12Updated 3 months ago
• simonw / datasette-faiss
  Maintain a FAISS index for specified Datasette tables
  ☆36Updated 11 months ago
• dennisbakhuis / tqdm_batch
  Batch processing using joblib including tqdm progress bars
  ☆20Updated 3 years ago
• simonw / llm-markov
  Plugin for LLM adding a Markov chain generating model
  ☆19Updated 11 months ago
• MantisAI / prompt_engineering
  Code that accompanies the PyData New York (2022) talk: Addressing the sensitivity of Large language models
  ☆13Updated 2 years ago
• meltano / llm-data-backend-meltano
  ☆11Updated last year
• chawlasahaj / dsiprojects
  A collection of projects I did while at General Assembly Singapore - as part of Data Science Immersive
  ☆11Updated 4 years ago
• raphaelsty / textokb
  Extract knowledge from raw text
  ☆13Updated 3 years ago
• ashen007 / LiteratureReview
  scrapper for various science databases
  ☆11Updated last year
• simonw / datasette-openai
  SQL functions for calling OpenAI APIs
  ☆21Updated 2 years ago
• agustif / llm-arxiv
  arXiv fragment loader plugin for https://llm.datasette.io/
  ☆14Updated 2 weeks ago
• simonw / datasette-publish-vercel
  Datasette plugin for publishing data using Vercel
  ☆44Updated 2 years ago
• jamwil / bulletproof-python
  A magic-free, understandable python project template using tox, pytest, ruff and pip-tools.
  ☆35Updated last month
• modal-labs / cadre
  🛠 Self-hosted, fast, and consistent remote configuration for apps.
  ☆15Updated 2 years ago
• paysure / orinoco
  Functional composable pipelines allowing clean separation of the business logic and its implementation
  ☆11Updated last year
• data-describe / awesome-data-science-models
  A few end to end examples that use data-describe
  ☆16Updated 2 years ago
• simonw / llm-groq
  ☆11Updated 4 months ago
• SsebowaDisan / ssebowa
  Ssebowa is free and open source library in Python that provides generative-ai models.
  ☆14Updated last year
• simonw / datasette-render-images
  Datasette plugin that renders binary blob images using data-uris
  ☆23Updated last year
• bodealamu / datamallet
  Datamallet is a python library which contains several helper functions and module for the common tasks in a typical data science workflow…
  ☆11Updated 3 years ago
• logicalpath / photomanage
  Scripts and ideas to manage tons and tons of images and movies
  ☆17Updated 2 months ago
• simonw / llm-nomic-api-embed
  Create embeddings for LLM using the Nomic API
  ☆23Updated 6 months ago
• hydrosquall / datasette-nteract-data-explorer
  automatic visual data explorer for datasette
  ☆12Updated 2 years ago
• opendatadiscovery / odd-collectors
  ☆9Updated 4 months ago