vishwajeetdabholkar / eGet-Crawler-for-ai
Web scraping framework built for AI applications. Extract clean, structured content from any website with dynamic content handling, markdown conversion, and intelligent crawling capabilities. Perfect for RAG applications and AI training data pipelines. Features async processing, browser management, and Prometheus monitoring.
☆43Updated last month
Alternatives and similar repositories for eGet-Crawler-for-ai:
Users that are interested in eGet-Crawler-for-ai are comparing it to the libraries listed below
- ☆33Updated last month
- PDF intelligence platform combining IBM Docling for document processing, LlamaIndex for data structuring, and Streamlit for a powerful UI…☆41Updated 3 months ago
- AI agent with RAG+ReAct on Indian Constitution & BNS☆61Updated 5 months ago
- ☆41Updated 4 months ago
- Build a Recommendation System Agent using LATS Agent Approach☆28Updated last month
- Chat to your Database GenAI Chatbot☆33Updated 4 months ago
- This is a repository which uses LangChain LangGraph and DuckduckGo to create a Perplexity Clone☆79Updated 6 months ago
- ☆35Updated 8 months ago
- Demo showcasing how to output CrewAI agent task outputs on the Streamlit UI.☆45Updated last month
- ☆36Updated 3 months ago
- ☆79Updated 6 months ago
- ☆81Updated 2 weeks ago
- A practical RAG where you can download and chat with github repo☆72Updated 2 months ago
- This project involves using llamaindex Multi Agents concierge system and Qdrant vector database to customize the RAG application with use…☆48Updated 7 months ago
- An Email manager that takes over your inbox, prioritizing messages, reading attachments and drafting replies so you can focus on what tru…☆84Updated last week
- An assistant for Slack built with Arcade and Langgraph. Interact with Google Calendar, Mail, Github, Search Engines, Firecrawl and more a…☆69Updated 3 weeks ago
- ☆29Updated last year
- ☆53Updated 5 months ago
- ☆78Updated 4 months ago
- ☆68Updated 6 months ago
- RAG with postgreSQL(nebius) and pgvector☆24Updated 4 months ago
- ☆37Updated 3 weeks ago
- ☆61Updated 6 months ago
- ☆21Updated 5 months ago
- Tutorial on how to create a ReAct agent without a LLM framework☆49Updated 8 months ago
- this project will bootstrap and scaffold the projects for specific semantic search and RAG applications along with regular boiler plate c…☆89Updated 3 months ago
- AutoCodeAgent - An innovative AI agent powered by IntelliChain, Deep Search, and multi-RAG techniques☆31Updated 3 weeks ago
- All code related to medium articles☆17Updated last week
- An implementation of an iterative knowledge base search agent using Agno agent framework, inspired by Ashpreet DeepKnowledge concept usin…☆14Updated 2 months ago
- GenAI Experimentation☆58Updated 2 months ago