vishwajeetdabholkar / eGet-Crawler-for-ai
Web scraping framework built for AI applications. Extract clean, structured content from any website with dynamic content handling, markdown conversion, and intelligent crawling capabilities. Perfect for RAG applications and AI training data pipelines. Features async processing, browser management, and Prometheus monitoring.
☆41Updated this week
Alternatives and similar repositories for eGet-Crawler-for-ai:
Users that are interested in eGet-Crawler-for-ai are comparing it to the libraries listed below
- Tutorial on how to create a ReAct agent without a LLM framework☆45Updated 7 months ago
- PDF intelligence platform combining IBM Docling for document processing, LlamaIndex for data structuring, and Streamlit for a powerful UI…☆36Updated last month
- ☆32Updated 7 months ago
- This is a repository which uses LangChain LangGraph and DuckduckGo to create a Perplexity Clone☆75Updated 4 months ago
- ☆27Updated 3 months ago
- ☆72Updated 2 months ago
- ☆57Updated 4 months ago
- A Newsletter Agent that Aggregates Articles and Generates a Newsletter - Langflow, NextJS☆46Updated 2 months ago
- ☆72Updated 4 months ago
- GenAI Experimentation☆57Updated 3 weeks ago
- ☆63Updated 4 months ago
- ☆36Updated 2 months ago
- A library for evaluating Retrieval-Augmented Generation (RAG) systems (The traditional ways).☆31Updated 6 months ago
- Generate Tools and Toolkits from any Python SDK -- no extra code required☆50Updated 3 months ago
- A free open source RAG based AI legal assistant.☆66Updated last week
- Groq-Whisper Fast Transcription App built using Groq API and Streamlit.☆22Updated 4 months ago
- RAG with postgreSQL(nebius) and pgvector☆24Updated 2 months ago
- ☆29Updated 11 months ago
- ☆32Updated 6 months ago
- ☆21Updated 3 months ago
- ☆49Updated 2 months ago
- Agent that summarizes the Linkedin Articles into Post content☆34Updated 4 months ago
- A LLM Agent with Langchain/Langgraph helps to analyze CV, look relevant jobs via API, and write a cover letter according to it☆46Updated 9 months ago
- Graphy v1: A Realtime GraphRAG App using Langchain, Neo4j, GPT-4o, and Streamlit.☆47Updated 4 months ago
- A repository Payman + Langgraph integration examples that allow AI Agent to simply create tasks for Humans on Payman that pay them money …☆78Updated 4 months ago