vishwajeetdabholkar / eGet-Crawler-for-aiLinks
Web scraping framework built for AI applications. Extract clean, structured content from any website with dynamic content handling, markdown conversion, and intelligent crawling capabilities. Perfect for RAG applications and AI training data pipelines. Features async processing, browser management, and Prometheus monitoring.
☆51Updated 4 months ago
Alternatives and similar repositories for eGet-Crawler-for-ai
Users that are interested in eGet-Crawler-for-ai are comparing it to the libraries listed below
Sorting:
- Example LangGraph flow that does "competitor analysis" on the web.☆38Updated last year
- Turn topics, links, and files into AI-generated research notebooks — summarize, explore, and ask anything.☆145Updated 7 months ago
- ☆49Updated last year
- Diagnose the performance of your RAG🩺☆42Updated 9 months ago
- Demo showcasing how to output CrewAI agent task outputs on the Streamlit UI.☆66Updated 11 months ago
- Collaborative Multi-Agent RAG with CrewAI☆70Updated last year
- ☆89Updated 8 months ago
- ☆23Updated last year
- A Newsletter Agent that Aggregates Articles and Generates a Newsletter - Langflow, NextJS☆61Updated last year
- A few examples of how Dendrite's SDK can be used to automate web processes and build AI agents.☆40Updated last year
- Lyzr SDKs help you to build all your favorite GenAI SaaS products as enterprise applications in minutes.☆190Updated last year
- Design Patterns for Multi Agents Frameworks Like Autogen, Langraph, Taskweaver,Crewai,etc☆84Updated last year
- Agentic RAG using Crew AI.☆31Updated last year
- CrewAI agents that gather and analyze YouTube comments to generate insights to inform better content creation.☆64Updated last year
- ☆43Updated last year
- Multi-Agents using Workflows☆54Updated last year
- Cookbooks and tutorials on Literal AI☆55Updated last year
- Research assistant for performing online research on a given topic, using Llamaindex Workflows and Tavily API. Inspired by GPT-Researcher☆169Updated last year
- PDF intelligence platform combining IBM Docling for document processing, LlamaIndex for data structuring, and Streamlit for a powerful UI…☆51Updated last year
- 101 for setting up adaptive RAG☆24Updated last year
- A tool for summarizing search results and website content using FAISS, LLMs, and the Retrieval-Augmented Generation (RAG) technique.☆30Updated 9 months ago
- RAG with postgreSQL(nebius) and pgvector☆25Updated last year
- Agentic Chat App is an advanced AI-powered chat application designed for seamless real-time communication and intelligent responses. Buil…☆106Updated last year
- A LLM Agent with Langchain/Langgraph helps to analyze CV, look relevant jobs via API, and write a cover letter according to it☆59Updated last year
- This template demonstrates how to create a collaborative team of AI agents that work together to process, analyze, and generate insights …☆51Updated last year
- Graphy v1: A Realtime GraphRAG App using Langchain, Neo4j, GPT-4o, and Streamlit.☆71Updated last year
- Automate web research way beyond the first page of search results; curate knowledge bases to chat with.☆44Updated 5 months ago
- An application built on the Model Context Protocol (MCP) that transforms any website into highly relevant content based on your queries. …☆63Updated 9 months ago
- ☆39Updated last year
- An AI Clone For Any X Profile☆93Updated last year