vishwajeetdabholkar / eGet-Crawler-for-aiLinks
Web scraping framework built for AI applications. Extract clean, structured content from any website with dynamic content handling, markdown conversion, and intelligent crawling capabilities. Perfect for RAG applications and AI training data pipelines. Features async processing, browser management, and Prometheus monitoring.
☆45Updated 3 months ago
Alternatives and similar repositories for eGet-Crawler-for-ai
Users that are interested in eGet-Crawler-for-ai are comparing it to the libraries listed below
Sorting:
- Turn topics, links, and files into AI-generated research notebooks — summarize, explore, and ask anything.☆44Updated this week
- ☆22Updated 7 months ago
- Demo showcasing how to output CrewAI agent task outputs on the Streamlit UI.☆55Updated 3 months ago
- ☆37Updated 10 months ago
- ☆38Updated last month
- ☆34Updated last month
- Example LangGraph flow that does "competitor analysis" on the web.☆29Updated last year
- ☆43Updated 6 months ago
- ☆13Updated 5 months ago
- Chat to your Database GenAI Chatbot☆34Updated 5 months ago
- Agentic RAG using Crew AI.☆29Updated 11 months ago
- Perplexity Lite using Langgraph, Tavily, and GPT-4.☆14Updated last year
- Widest collection of generative ai usecases in enterprise & startups☆19Updated last year
- PDF intelligence platform combining IBM Docling for document processing, LlamaIndex for data structuring, and Streamlit for a powerful UI…☆43Updated 5 months ago
- ☆38Updated this week
- ☆91Updated this week
- All code related to medium articles☆17Updated last week
- This is a repository which uses LangChain LangGraph and DuckduckGo to create a Perplexity Clone☆79Updated 7 months ago
- Design Patterns for Multi Agents Frameworks Like Autogen, Langraph, Taskweaver,Crewai,etc☆52Updated last year
- ☆64Updated 8 months ago
- This repository will contain projects on multi-agent applications using frameworks such as crewai, langchain, gradio, hugging face etc.☆23Updated 9 months ago
- A Newsletter Agent that Aggregates Articles and Generates a Newsletter - Langflow, NextJS☆56Updated 6 months ago
- ☆31Updated last month
- An implementation of an iterative knowledge base search agent using Agno agent framework, inspired by Ashpreet DeepKnowledge concept usin…☆14Updated 3 months ago
- Design Patterns for Multi Agents Frameworks Like Autogen, Langraph, Taskweaver, Crewai,etc☆44Updated last year
- ☆86Updated 3 weeks ago
- This program uses CrewAI to build a web-app using three agents doing some research stuff in the internet.☆70Updated last year
- This repository is a combination of llama workflows and agents together which is a powerful concept.☆17Updated 9 months ago
- ☆32Updated last month
- This open-source project & guide shows you exactly how to implement Canvas UX pattern + LangGraph human-in-the-loop workflows in your AI …☆76Updated 2 months ago