vishwajeetdabholkar / eGet-Crawler-for-aiLinks
Web scraping framework built for AI applications. Extract clean, structured content from any website with dynamic content handling, markdown conversion, and intelligent crawling capabilities. Perfect for RAG applications and AI training data pipelines. Features async processing, browser management, and Prometheus monitoring.
☆46Updated last week
Alternatives and similar repositories for eGet-Crawler-for-ai
Users that are interested in eGet-Crawler-for-ai are comparing it to the libraries listed below
Sorting:
- ☆47Updated 9 months ago
- ☆23Updated 10 months ago
- Turn topics, links, and files into AI-generated research notebooks — summarize, explore, and ask anything.☆139Updated 3 months ago
- Demo showcasing how to output CrewAI agent task outputs on the Streamlit UI.☆64Updated 7 months ago
- Example LangGraph flow that does "competitor analysis" on the web.☆34Updated last year
- ☆35Updated 4 months ago
- ☆89Updated 4 months ago
- ☆37Updated 7 months ago
- Diagnose the performance of your RAG🩺☆42Updated 5 months ago
- This project involves using llamaindex Multi Agents concierge system and Qdrant vector database to customize the RAG application with use…☆55Updated last year
- Chat to your Database GenAI Chatbot☆36Updated this week
- An application built on the Model Context Protocol (MCP) that transforms any website into highly relevant content based on your queries. …☆62Updated 5 months ago
- ☆53Updated 11 months ago
- A LLM Agent with Langchain/Langgraph helps to analyze CV, look relevant jobs via API, and write a cover letter according to it☆59Updated last year
- ☆74Updated 11 months ago
- A few examples of how Dendrite's SDK can be used to automate web processes and build AI agents.☆41Updated 10 months ago
- Automate complex business workflows with our Multi-AI-Agent Systems using crewAI. This framework leverages autonomous, role-specific AI a…☆137Updated last year
- Build a Recommendation System Agent using LATS Agent Approach☆32Updated 6 months ago
- ☆46Updated 4 months ago
- Collaborative Multi-Agent RAG with CrewAI☆66Updated last year
- A tool for summarizing search results and website content using FAISS, LLMs, and the Retrieval-Augmented Generation (RAG) technique.☆30Updated 5 months ago
- PDF intelligence platform combining IBM Docling for document processing, LlamaIndex for data structuring, and Streamlit for a powerful UI…☆48Updated 8 months ago
- ☆38Updated last year
- Python examples using gotoHuman and LangGraph☆45Updated 6 months ago
- ⚡Ship RAG Solutions Quickly and effortlessly☆152Updated last year
- Perplexity Lite using Langgraph, Tavily, and GPT-4.☆14Updated last year
- A repository Payman + Langgraph integration examples that allow AI Agent to simply create tasks for Humans on Payman that pay them money …☆85Updated 11 months ago
- RAG with postgreSQL(nebius) and pgvector☆24Updated 9 months ago
- This program uses CrewAI to build a web-app using three agents doing some research stuff in the internet.☆70Updated last year
- Agentic Chat App is an advanced AI-powered chat application designed for seamless real-time communication and intelligent responses. Buil…☆94Updated last year