Blacksuan19 / scrapy-aiLinks
Fully automated AI based web scraping.
☆28Updated 8 months ago
Alternatives and similar repositories for scrapy-ai
Users that are interested in scrapy-ai are comparing it to the libraries listed below
Sorting:
- Spider ported to Python☆94Updated 9 months ago
- Build super simple end-to-end data & ETL pipelines for your vector databases and Generative AI applications☆104Updated last year
- ☆20Updated 7 months ago
- Python SDK for Inngest: Durable functions and workflows in Python, hosted anywhere☆143Updated this week
- Python SDK for Browserbase☆67Updated last week
- scraping and querying documents for LLMs☆24Updated 3 weeks ago
- Real-time collaborative notebook that thinks with you☆38Updated this week
- A Python-based parallel file chunking system designed for processing large codebases into LLM-friendly chunks.☆44Updated 2 months ago
- Docx tracked change redlines for the Python ecosystem.☆87Updated last year
- Visual Studio Code extension to convert HTML to FastHTML FT☆19Updated 8 months ago
- Analyzing chat interactions w/ LLMs to improve 🦜🔗 Langchain docs☆80Updated 2 years ago
- Clean, filter and sample URLs to optimize data collection – Python & command-line – Deduplication, spam, content and language filters☆149Updated 10 months ago
- Taking Normal Text as Input and Generating SQL commands using the OpenAI's GPT-3☆15Updated 5 years ago
- https://verdad.app☆83Updated last week
- Apify API client for Python☆81Updated this week
- Spider templates for automatic crawlers.☆32Updated last month
- Effortlessly extract information from unstructured data with this library, utilizing advanced AI techniques. Compose AI in customizable p…☆85Updated last year
- new skills taxonomy using TextKernel data☆35Updated 3 years ago
- LLM-ready data connectors☆95Updated last year
- Handout for a talk I gave about LLM and CLI tools☆62Updated last year
- This is a proof-of-concept of using an LLM to find and extract meaningful data without parsing the html too much.☆30Updated 2 years ago
- ☆22Updated last year
- Python SDK for Permit.io: Plug & Play Application Level Authorization☆14Updated last month
- A Tavily-based agent generating evaluation datasets for web search RAG systems.☆22Updated 4 months ago
- ☆76Updated 7 months ago
- 🦦 weasel: A small and easy workflow system☆86Updated last year
- Example LangGraph flow that does "competitor analysis" on the web.☆36Updated last year
- A FastAPI extension for integrating common AI agent frameworks.☆45Updated 9 months ago
- agenty☆43Updated 8 months ago
- S3 vector database for LLM Agents and RAG.☆48Updated 2 years ago