vishwajeetdabholkar / eGet-Crawler-for-aiLinks
Web scraping framework built for AI applications. Extract clean, structured content from any website with dynamic content handling, markdown conversion, and intelligent crawling capabilities. Perfect for RAG applications and AI training data pipelines. Features async processing, browser management, and Prometheus monitoring.
β46Updated last month
Alternatives and similar repositories for eGet-Crawler-for-ai
Users that are interested in eGet-Crawler-for-ai are comparing it to the libraries listed below
Sorting:
- Diagnose the performance of your RAGπ©Ίβ42Updated 6 months ago
- β49Updated 11 months ago
- Controllable-RAG-Agent using Langgraphβ36Updated 2 months ago
- Demo showcasing how to output CrewAI agent task outputs on the Streamlit UI.β66Updated 8 months ago
- β41Updated last year
- A tool for summarizing search results and website content using FAISS, LLMs, and the Retrieval-Augmented Generation (RAG) technique.β30Updated 7 months ago
- Turn topics, links, and files into AI-generated research notebooks β summarize, explore, and ask anything.β140Updated 4 months ago
- A LLM Agent with Langchain/Langgraph helps to analyze CV, look relevant jobs via API, and write a cover letter according to itβ59Updated last year
- Build a Recommendation System Agent using LATS Agent Approachβ33Updated 8 months ago
- Automate complex business workflows with our Multi-AI-Agent Systems using crewAI. This framework leverages autonomous, role-specific AI aβ¦β142Updated last year
- Master the art of designing and organizing AI agents. Learn to automate complex, multi-step business processes by creating specialized AIβ¦β118Updated last year
- PDF intelligence platform combining IBM Docling for document processing, LlamaIndex for data structuring, and Streamlit for a powerful UIβ¦β51Updated 10 months ago
- β74Updated last year
- Explore the must-have external ready-made toolkits to integrate with your AI agents built with Python and TypeScriptβ76Updated 9 months ago
- β53Updated last year
- β23Updated last year
- An application built on the Model Context Protocol (MCP) that transforms any website into highly relevant content based on your queries. β¦β63Updated 6 months ago
- Example LangGraph flow that does "competitor analysis" on the web.β36Updated last year
- This project involves using llamaindex Multi Agents concierge system and Qdrant vector database to customize the RAG application with useβ¦β56Updated last year
- Graphy v1: A Realtime GraphRAG App using Langchain, Neo4j, GPT-4o, and Streamlit.β67Updated last year
- β37Updated last year
- β43Updated 6 months ago
- Collaborative Multi-Agent RAG with CrewAIβ65Updated last year
- An AI agent that automates company research and lead prospecting (powered by langgraph and firecrawl)β164Updated 9 months ago
- Design Patterns for Multi Agents Frameworks Like Autogen, Langraph, Taskweaver,Crewai,etcβ71Updated last year
- CrewAI agents that gather and analyze YouTube comments to generate insights to inform better content creation.β63Updated last year
- β89Updated 5 months ago
- β41Updated last year
- β‘Ship RAG Solutions Quickly and effortlesslyβ157Updated last year
- A few examples of how Dendrite's SDK can be used to automate web processes and build AI agents.β41Updated last year