Blacksuan19 / scrapy-aiLinks
Fully automated AI based web scraping.
☆33Updated 10 months ago
Alternatives and similar repositories for scrapy-ai
Users that are interested in scrapy-ai are comparing it to the libraries listed below
Sorting:
- Spider ported to Python☆100Updated 11 months ago
- scraping and querying documents for LLMs☆24Updated 3 months ago
- Python SDK for Inngest: Durable functions and workflows in Python, hosted anywhere☆167Updated last week
- Python SDK for Browserbase☆70Updated 2 weeks ago
- Build super simple end-to-end data & ETL pipelines for your vector databases and Generative AI applications☆106Updated last year
- Docx tracked change redlines for the Python ecosystem.☆95Updated last year
- ☆22Updated last year
- The faststream-gen library uses advanced AI to generate FastStream code from user descriptions, speeding up FastStream app development.☆48Updated last year
- Taking Normal Text as Input and Generating SQL commands using the OpenAI's GPT-3☆15Updated 5 years ago
- simplifies the process of creating and managing LLM workflows.☆114Updated last year
- A Python-based parallel file chunking system designed for processing large codebases into LLM-friendly chunks.☆47Updated 4 months ago
- https://verdad.app☆83Updated last week
- Open Source LLMOps tool for AI teams☆129Updated 10 months ago
- A Tavily-based agent generating evaluation datasets for web search RAG systems.☆24Updated 7 months ago
- Docker Streamlit Template☆36Updated 3 months ago
- A Prodigy plugin for PDF annotation☆36Updated 4 months ago
- Apify API client for Python☆88Updated this week
- ☆20Updated 9 months ago
- A microframework for creating simple AI agents.☆94Updated last year
- This repository is designed for deploying and managing server processes that handle embeddings using the Infinity Embedding model or Larg…☆26Updated 10 months ago
- Effortlessly extract information from unstructured data with this library, utilizing advanced AI techniques. Compose AI in customizable p…☆87Updated last year
- Clean, filter and sample URLs to optimize data collection – Python & command-line – Deduplication, spam, content and language filters☆155Updated 2 weeks ago
- Extract structured data from any content using LLMs.☆103Updated last month
- Sculpt: Structuring unstructured data with LLMs☆38Updated 3 months ago
- Multimodal document parser for high quality data understanding and extraction☆89Updated last week
- Repo to experiment with Graph RAG strategies using Kùzu☆63Updated 3 months ago
- Type-complete Python wrapper for the Reddit API.☆51Updated last year
- LLM prompt language based on Jinja. Banks provides tools and functions to build prompts text and chat messages from generic blueprints. I…☆119Updated 3 weeks ago
- An example to use MultiModal capabilities with Pydantic-AI to process and analyze images☆36Updated last year
- Import unstructured data (text and images) into structured tables☆163Updated last month