Alternatives and similar repositories for web-scraping-pipeline

Users that are interested in web-scraping-pipeline are comparing it to the libraries listed below

• prrao87 / db-hub-fastapi
  Async bulk data ingestion and querying in various document, graph and vector databases via their Python clients
  ☆40Updated 2 years ago
• ArielLahiany / platform
  All Saleor services started from a single repository with Ansible, Terraform, and Kubernetes.
  ☆21Updated 4 years ago
• DerwenAI / textgraphs
  TextGraphs + LLMs + graph ML for entity extraction, linking, ranking, and constructing a lemma graph
  ☆25Updated last year
• permitio / permit-python
  Python SDK for Permit.io: Plug & Play Application Level Authorization
  ☆15Updated last month
• Dicklesworthstone / youtube_transcript_cleaner
  YouTube Transcript Cleaner is a simple web-based application that improves the readability of YouTube transcripts.
  ☆26Updated 8 months ago
• datasette / datasette-write-ui
  A Datasette plugin that adds UI elements to edit, insert, or delete rows in SQLite tables
  ☆21Updated last week
• go-go-golems / geppetto
  golang GPT3 tooling
  ☆83Updated last week
• lakshmanok / lakblogs
  Code and notebooks associated with my blogposts
  ☆65Updated last week
• geniusrise / geniusrise
  Geniusrise: Framework for building geniuses
  ☆60Updated last year
• learn-co-curriculum / dsc-pandas-data-cleaning-lab
  ☆28Updated last year
• outerbounds / metaflow-ray
  ☆26Updated 8 months ago
• kyegomez / dev-swarm
  A swarm of LLM agents that will help you test, document, and productionize your code!
  ☆16Updated last week
• endatabas / endb-book
  The Endatabas Book
  ☆16Updated last year
• sourcery-ai / sourcery-rules
  ☆12Updated 2 years ago
• meltano / llm-data-backend-meltano
  ☆11Updated 2 years ago
• simonw / llm-cluster
  LLM plugin for clustering embeddings
  ☆82Updated last year
• slai-labs / get-beam
  Run GPU inference and training jobs on serverless infrastructure that scales with you.
  ☆102Updated last year
• astronomer / use-case-airflow-llm-rag-finance
  Repository for the LLMOps RAG with Airflow + Weaviate Learn use case.
  ☆37Updated last year
• kyegomez / Exa
  Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…
  ☆25Updated 11 months ago
• The-Swarm-Corporation / swarms-cloud
  Deploy your autonomous agents to production grade environments with 99% Uptime Guarantee, Infinite Scalability, and self-healing.
  ☆47Updated 3 weeks ago
• waynehamadi / AI-Maintainer
  AutoGPT maintainer/reviewer system
  ☆16Updated 2 years ago
• simonw / scrape-fediverse
  Git scrapers for scraping the fediverse
  ☆16Updated this week
• fmind / bromate
  Web browser automation through agentic workflows.
  ☆20Updated last year
• dapensoft / pyorlib
  A powerful Python library for operations research and optimization.
  ☆20Updated 3 months ago
• cloudhut / owl-shop
  ☆39Updated last year
• airbytehq / dagster-langchain
  POC integration Airbyte+Dagster+Langchain
  ☆13Updated 2 years ago
• parlance-labs / langfree
  Leverage your LangChain trace data for fine tuning
  ☆46Updated last year
• AntonOvsyannikov / pure-teleapi
  Pure declarative Telegram Bot API implementation with Pydantic models and Protocol-inherited API definitions (both sync and async) with n…
  ☆16Updated 7 months ago
• cfahlgren1 / hf-data-explorer
  Chrome Extension for exploring Hugging Face datasets 🔎
  ☆49Updated last year
• agentsea / agentd
  A daemon that makes a desktop OS accessible to AI agents
  ☆34Updated 5 months ago