Blacksuan19 / scrapy-aiLinks
Fully automated AI based web scraping.
☆25Updated 5 months ago
Alternatives and similar repositories for scrapy-ai
Users that are interested in scrapy-ai are comparing it to the libraries listed below
Sorting:
- scraping and querying documents for LLMs☆23Updated 2 months ago
- Build super simple end-to-end data & ETL pipelines for your vector databases and Generative AI applications☆101Updated 10 months ago
- Spider ported to Python☆89Updated 6 months ago
- simplifies the process of creating and managing LLM workflows.☆107Updated 9 months ago
- https://verdad.app☆83Updated 7 months ago
- A FastAPI extension for integrating common AI agent frameworks.☆42Updated 6 months ago
- Python SDK for Inngest: Durable functions and workflows in Python, hosted anywhere☆111Updated 3 weeks ago
- Code examples for Building Effective Agents ported and adapted to use Pydantic AI☆86Updated 7 months ago
- Real-time collaborative notebook that thinks with you☆29Updated this week
- A Python-based parallel file chunking system designed for processing large codebases into LLM-friendly chunks.☆42Updated 3 weeks ago
- LLM-ready data connectors☆87Updated last year
- Repo to experiment with Graph RAG strategies using Kùzu☆57Updated 8 months ago
- Benchmark study on LanceDB, an embedded vector DB, for full-text search and vector search☆27Updated last year
- Open-source versioning, tracing, and annotation tooling.☆175Updated this week
- ☆75Updated 4 months ago
- Import unstructured data (text and images) into structured tables☆153Updated 3 months ago
- ☆22Updated 10 months ago
- ☆98Updated last month
- LLM prompt language based on Jinja. Banks provides tools and functions to build prompts text and chat messages from generic blueprints. I…☆113Updated 3 weeks ago
- DuckDB Community Extension to prompt LLMs from SQL☆50Updated 7 months ago
- ☆49Updated 5 months ago
- S3 vector database for LLM Agents and RAG.☆47Updated last year
- Easiest way to give context to LLMs; Attachments has the ambition to be the general funnel for any files to be transformed into images+te…☆235Updated 3 weeks ago
- This is a proof-of-concept of using an LLM to find and extract meaningful data without parsing the html too much.☆29Updated 2 years ago
- A GPT powered CLI tool that answers questions about your data☆98Updated 2 years ago
- Handout for a talk I gave about LLM and CLI tools☆63Updated last year
- Docx tracked change redlines for the Python ecosystem.☆75Updated last year
- Analyzing chat interactions w/ LLMs to improve 🦜🔗 Langchain docs☆80Updated 2 years ago
- Turn any input document into a sophisticated, context-dependent mindmap that distills the meaning and structure of the document.☆70Updated 5 months ago
- A microframework for creating simple AI agents.☆91Updated last year