vishwajeetdabholkar / eGet-Crawler-for-aiLinks
Web scraping framework built for AI applications. Extract clean, structured content from any website with dynamic content handling, markdown conversion, and intelligent crawling capabilities. Perfect for RAG applications and AI training data pipelines. Features async processing, browser management, and Prometheus monitoring.
☆45Updated 4 months ago
Alternatives and similar repositories for eGet-Crawler-for-ai
Users that are interested in eGet-Crawler-for-ai are comparing it to the libraries listed below
Sorting:
- ☆37Updated 11 months ago
- Demo showcasing how to output CrewAI agent task outputs on the Streamlit UI.☆59Updated 4 months ago
- All code related to medium articles☆17Updated this week
- Example LangGraph flow that does "competitor analysis" on the web.☆31Updated last year
- ☆45Updated 7 months ago
- Turn topics, links, and files into AI-generated research notebooks — summarize, explore, and ask anything.☆121Updated 2 weeks ago
- ☆13Updated 5 months ago
- Create Python APIs with AI Agents.☆11Updated 10 months ago
- Widest collection of generative ai usecases in enterprise & startups☆19Updated last year
- ☆34Updated last month
- Agentic RAG using Crew AI.☆29Updated last year
- A Newsletter Agent that Aggregates Articles and Generates a Newsletter - Langflow, NextJS☆56Updated 6 months ago
- CrewAI agents that gather and analyze YouTube comments to generate insights to inform better content creation.☆61Updated last year
- Agent that summarizes the Linkedin Articles into Post content☆36Updated 8 months ago
- Collaborative Multi-Agent RAG with CrewAI☆63Updated last year
- ☆37Updated 10 months ago
- ☆13Updated last year
- ☆61Updated 3 months ago
- ☆87Updated last month
- ☆66Updated 9 months ago
- PDF intelligence platform combining IBM Docling for document processing, LlamaIndex for data structuring, and Streamlit for a powerful UI…☆44Updated 5 months ago
- Payman + Langchain repository that lets AI Agents send real money.☆91Updated 4 months ago
- A tool for summarizing search results and website content using FAISS, LLMs, and the Retrieval-Augmented Generation (RAG) technique.☆30Updated 3 months ago
- ☆13Updated 6 months ago
- ☆37Updated last year
- Collection of impressive LLM apps with a focus on the financial sector☆68Updated 2 months ago
- Chainlit app for advanced RAG. Uses llamaparse, langchain, qdrant and models from groq.☆45Updated last year
- A quick Crew AI tutorial☆23Updated last year
- Sales AI agent that talks with your customers, recommend products, book consultations, and process Stripe payments☆44Updated 6 months ago
- This program uses CrewAI to build a web-app using three agents doing some research stuff in the internet.☆71Updated last year