Alternatives and similar repositories for scrapy-ai

Users that are interested in scrapy-ai are comparing it to the libraries listed below

• spider-rs / spider-py
  Spider ported to Python
  ☆94Updated 9 months ago
• ContextData / VectorETL
  Build super simple end-to-end data & ETL pipelines for your vector databases and Generative AI applications
  ☆104Updated last year
• zytedata / zyte-spider-templates-project
  ☆20Updated 7 months ago
• inngest / inngest-py
  Python SDK for Inngest: Durable functions and workflows in Python, hosted anywhere
  ☆143Updated this week
• browserbase / sdk-python
  Python SDK for Browserbase
  ☆67Updated last week
• zzstoatzz / raggy
  scraping and querying documents for LLMs
  ☆24Updated 3 weeks ago
• runtimed / anode
  Real-time collaborative notebook that thinks with you
  ☆38Updated this week
• duriantaco / pykomodo
  A Python-based parallel file chunking system designed for processing large codebases into LLM-friendly chunks.
  ☆44Updated 2 months ago
• JSv4 / Python-Redlines
  Docx tracked change redlines for the Python ecosystem.
  ☆87Updated last year
• callmephilip / html2ft
  Visual Studio Code extension to convert HTML to FastHTML FT
  ☆19Updated 8 months ago
• firecrawl / QA_clustering
  Analyzing chat interactions w/ LLMs to improve 🦜🔗 Langchain docs
  ☆80Updated 2 years ago
• adbar / courlan
  Clean, filter and sample URLs to optimize data collection – Python & command-line – Deduplication, spam, content and language filters
  ☆149Updated 10 months ago
• islamshahil / Text-To-SQL-Using-GPT-3
  Taking Normal Text as Input and Generating SQL commands using the OpenAI's GPT-3
  ☆15Updated 5 years ago
• PublicDataWorks / verdad
  https://verdad.app
  ☆83Updated last week
• apify / apify-client-python
  Apify API client for Python
  ☆81Updated this week
• zytedata / zyte-spider-templates
  Spider templates for automatic crawlers.
  ☆32Updated last month
• Xyntopia / pydoxtools
  Effortlessly extract information from unstructured data with this library, utilizing advanced AI techniques. Compose AI in customizable p…
  ☆85Updated last year
• nestauk / skills-taxonomy-v2
  new skills taxonomy using TextKernel data
  ☆35Updated 3 years ago
• firecrawl / data-connectors
  LLM-ready data connectors
  ☆95Updated last year
• simonw / language-models-on-the-command-line
  Handout for a talk I gave about LLM and CLI tools
  ☆62Updated last year
• repollo / llm_data_parser
  This is a proof-of-concept of using an LLM to find and extract meaningful data without parsing the html too much.
  ☆30Updated 2 years ago
• gormlabenz / topcast
  ☆22Updated last year
• permitio / permit-python
  Python SDK for Permit.io: Plug & Play Application Level Authorization
  ☆14Updated last month
• Eyalbenba / tavily-web-eval-generator
  A Tavily-based agent generating evaluation datasets for web search RAG systems.
  ☆22Updated 4 months ago
• pydantic / logfire-demo
  ☆76Updated 7 months ago
• explosion / weasel
  🦦 weasel: A small and easy workflow system
  ☆86Updated last year
• langchain-ai / competitor-analysis-bot
  Example LangGraph flow that does "competitor analysis" on the web.
  ☆36Updated last year
• blairhudson / fastapi-agents
  A FastAPI extension for integrating common AI agent frameworks.
  ☆45Updated 9 months ago
• jonchun / agenty
  agenty
  ☆43Updated 8 months ago
• msoedov / vector_lake
  S3 vector database for LLM Agents and RAG.
  ☆48Updated 2 years ago