vishwajeetdabholkar / eGet-Crawler-for-ai
Web scraping framework built for AI applications. Extract clean, structured content from any website with dynamic content handling, markdown conversion, and intelligent crawling capabilities. Perfect for RAG applications and AI training data pipelines. Features async processing, browser management, and Prometheus monitoring.
☆42Updated 3 weeks ago
Alternatives and similar repositories for eGet-Crawler-for-ai:
Users that are interested in eGet-Crawler-for-ai are comparing it to the libraries listed below
- ☆41Updated 4 months ago
- PDF intelligence platform combining IBM Docling for document processing, LlamaIndex for data structuring, and Streamlit for a powerful UI…☆42Updated 2 months ago
- This project involves using llamaindex Multi Agents concierge system and Qdrant vector database to customize the RAG application with use…☆48Updated 7 months ago
- GenAI Experimentation☆58Updated 2 months ago
- ☆59Updated 6 months ago
- This is a repository which uses LangChain LangGraph and DuckduckGo to create a Perplexity Clone☆78Updated 5 months ago
- ☆21Updated 4 months ago
- ☆36Updated 2 months ago
- Perplexity Lite using Langgraph, Tavily, and GPT-4.☆14Updated last year
- Dynamic Metadata based RAG Framework☆72Updated 7 months ago
- ☆77Updated 4 months ago
- Widest collection of generative ai usecases in enterprise & startups☆18Updated last year
- ☆90Updated last month
- All code related to medium articles☆16Updated last week
- Generate Tools and Toolkits from any Python SDK -- no extra code required☆50Updated 4 months ago
- ☆67Updated 5 months ago
- Tutorial on how to create a ReAct agent without a LLM framework☆48Updated 8 months ago
- AI agent with RAG+ReAct on Indian Constitution & BNS☆60Updated 5 months ago
- ☆29Updated last year
- Design Patterns for Multi Agents Frameworks Like Autogen, Langraph, Taskweaver,Crewai,etc☆39Updated 9 months ago
- ☆27Updated 5 months ago
- ☆56Updated 7 months ago
- ☆49Updated 3 months ago