vishwajeetdabholkar / eGet-Crawler-for-aiLinks
Web scraping framework built for AI applications. Extract clean, structured content from any website with dynamic content handling, markdown conversion, and intelligent crawling capabilities. Perfect for RAG applications and AI training data pipelines. Features async processing, browser management, and Prometheus monitoring.
☆46Updated last month
Alternatives and similar repositories for eGet-Crawler-for-ai
Users that are interested in eGet-Crawler-for-ai are comparing it to the libraries listed below
Sorting:
- A tool for summarizing search results and website content using FAISS, LLMs, and the Retrieval-Augmented Generation (RAG) technique.☆30Updated 6 months ago
- Demo showcasing how to output CrewAI agent task outputs on the Streamlit UI.☆65Updated 7 months ago
- ☆48Updated 10 months ago
- A LLM Agent with Langchain/Langgraph helps to analyze CV, look relevant jobs via API, and write a cover letter according to it☆59Updated last year
- Turn topics, links, and files into AI-generated research notebooks — summarize, explore, and ask anything.☆141Updated 4 months ago
- Diagnose the performance of your RAG🩺☆42Updated 6 months ago
- ☆23Updated 11 months ago
- An application built on the Model Context Protocol (MCP) that transforms any website into highly relevant content based on your queries. …☆63Updated 5 months ago
- ☆35Updated 5 months ago
- This program uses CrewAI to build a web-app using three agents doing some research stuff in the internet.☆69Updated last year
- PDF intelligence platform combining IBM Docling for document processing, LlamaIndex for data structuring, and Streamlit for a powerful UI…☆50Updated 9 months ago
- ☆37Updated last year
- GenAI Experimentation☆57Updated last month
- Research assistant for performing online research on a given topic, using Llamaindex Workflows and Tavily API. Inspired by GPT-Researcher☆168Updated last year
- Tutorial for AutoGen with Amadeus flights API, Parallel Function Calls☆48Updated last year
- Example LangGraph flow that does "competitor analysis" on the web.☆34Updated last year
- ☆74Updated last year
- ☆39Updated last year
- Widest collection of generative ai usecases in enterprise & startups☆19Updated last year
- Tutorial on how to create a ReAct agent without a LLM framework☆58Updated last year
- A few examples of how Dendrite's SDK can be used to automate web processes and build AI agents.☆41Updated 11 months ago
- A Newsletter Agent that Aggregates Articles and Generates a Newsletter - Langflow, NextJS☆60Updated 10 months ago
- Chainlit app for advanced RAG. Uses llamaparse, langchain, qdrant and models from groq.☆47Updated last year
- ☆131Updated 3 weeks ago
- Multi-Agents using Workflows☆53Updated 9 months ago
- This project involves using llamaindex Multi Agents concierge system and Qdrant vector database to customize the RAG application with use…☆55Updated last year
- Perplexity Lite using Langgraph, Tavily, and GPT-4.☆14Updated last year
- Design Patterns for Multi Agents Frameworks Like Autogen, Langraph, Taskweaver,Crewai,etc☆70Updated last year
- ☆53Updated 11 months ago
- Design Patterns for Multi Agents Frameworks Like Autogen, Langraph, Taskweaver, Crewai,etc☆67Updated last year