vishwajeetdabholkar / eGet-Crawler-for-aiLinks
Web scraping framework built for AI applications. Extract clean, structured content from any website with dynamic content handling, markdown conversion, and intelligent crawling capabilities. Perfect for RAG applications and AI training data pipelines. Features async processing, browser management, and Prometheus monitoring.
☆47Updated 2 months ago
Alternatives and similar repositories for eGet-Crawler-for-ai
Users that are interested in eGet-Crawler-for-ai are comparing it to the libraries listed below
Sorting:
- Example LangGraph flow that does "competitor analysis" on the web.☆37Updated last year
- ☆23Updated last year
- ☆49Updated 11 months ago
- Lyzr SDKs help you to build all your favorite GenAI SaaS products as enterprise applications in minutes.☆189Updated 11 months ago
- Design Patterns for Multi Agents Frameworks Like Autogen, Langraph, Taskweaver,Crewai,etc☆76Updated last year
- PDF intelligence platform combining IBM Docling for document processing, LlamaIndex for data structuring, and Streamlit for a powerful UI…☆51Updated 10 months ago
- Demo showcasing how to output CrewAI agent task outputs on the Streamlit UI.☆66Updated 9 months ago
- This program uses CrewAI to build a web-app using three agents doing some research stuff in the internet.☆70Updated last year
- A few examples of how Dendrite's SDK can be used to automate web processes and build AI agents.☆40Updated last year
- ☆74Updated last year
- ☆42Updated last year
- A tool for summarizing search results and website content using FAISS, LLMs, and the Retrieval-Augmented Generation (RAG) technique.☆30Updated 7 months ago
- CrewAI agents that gather and analyze YouTube comments to generate insights to inform better content creation.☆64Updated last year
- A LLM Agent with Langchain/Langgraph helps to analyze CV, look relevant jobs via API, and write a cover letter according to it☆59Updated last year
- ☆37Updated last year
- Graphy v1: A Realtime GraphRAG App using Langchain, Neo4j, GPT-4o, and Streamlit.☆70Updated last year
- Diagnose the performance of your RAG🩺☆42Updated 7 months ago
- Turn topics, links, and files into AI-generated research notebooks — summarize, explore, and ask anything.☆141Updated 5 months ago
- Automate complex business workflows with our Multi-AI-Agent Systems using crewAI. This framework leverages autonomous, role-specific AI a…☆146Updated last year
- Explore the must-have external ready-made toolkits to integrate with your AI agents built with Python and TypeScript☆77Updated 9 months ago
- 😎 Awesome list of tools and projects with the awesome LangChain framework☆19Updated 2 years ago
- Build a Recommendation System Agent using LATS Agent Approach☆33Updated 8 months ago
- Automate web research way beyond the first page of search results; curate knowledge bases to chat with.☆44Updated 3 months ago
- ☆89Updated 6 months ago
- Collaborative Multi-Agent RAG with CrewAI☆66Updated last year
- ☆37Updated last year
- ☆52Updated last year
- Design Patterns for Multi Agents Frameworks Like Autogen, Langraph, Taskweaver, Crewai,etc☆69Updated last year
- Perplexity Lite using Langgraph, Tavily, and GPT-4.☆14Updated last year
- The first platform designed to empower organizations by automating and enhancing their employment processes through advanced autonomous a…☆41Updated last year