vishwajeetdabholkar / eGet-Crawler-for-aiLinks
Web scraping framework built for AI applications. Extract clean, structured content from any website with dynamic content handling, markdown conversion, and intelligent crawling capabilities. Perfect for RAG applications and AI training data pipelines. Features async processing, browser management, and Prometheus monitoring.
☆45Updated 6 months ago
Alternatives and similar repositories for eGet-Crawler-for-ai
Users that are interested in eGet-Crawler-for-ai are comparing it to the libraries listed below
Sorting:
- ☆47Updated 9 months ago
- Turn topics, links, and files into AI-generated research notebooks — summarize, explore, and ask anything.☆136Updated 2 months ago
- ☆23Updated 10 months ago
- Diagnose the performance of your RAG🩺☆42Updated 4 months ago
- Demo showcasing how to output CrewAI agent task outputs on the Streamlit UI.☆64Updated 6 months ago
- ☆89Updated 3 months ago
- ☆40Updated 4 months ago
- A tool for summarizing search results and website content using FAISS, LLMs, and the Retrieval-Augmented Generation (RAG) technique.☆30Updated 5 months ago
- A LLM Agent with Langchain/Langgraph helps to analyze CV, look relevant jobs via API, and write a cover letter according to it☆59Updated last year
- Example LangGraph flow that does "competitor analysis" on the web.☆32Updated last year
- This project involves using llamaindex Multi Agents concierge system and Qdrant vector database to customize the RAG application with use…☆56Updated last year
- ☆34Updated 4 months ago
- Design Patterns for Multi Agents Frameworks Like Autogen, Langraph, Taskweaver,Crewai,etc☆66Updated last year
- PDF intelligence platform combining IBM Docling for document processing, LlamaIndex for data structuring, and Streamlit for a powerful UI…☆47Updated 8 months ago
- Lyzr SDKs help you to build all your favorite GenAI SaaS products as enterprise applications in minutes.☆183Updated 8 months ago
- An assistant for Slack built with Arcade and Langgraph. Interact with Google Calendar, Mail, Github, Search Engines, Firecrawl and more a…☆102Updated 2 months ago
- Python examples using gotoHuman and LangGraph☆45Updated 6 months ago
- Multi-Agents using Workflows☆52Updated 7 months ago
- Automated Data Analysis leveraging llms☆183Updated 8 months ago
- This program uses CrewAI to build a web-app using three agents doing some research stuff in the internet.☆71Updated last year
- ⚡Ship RAG Solutions Quickly and effortlessly☆149Updated last year
- Research assistant for performing online research on a given topic, using Llamaindex Workflows and Tavily API. Inspired by GPT-Researcher☆166Updated 11 months ago
- Perplexity Lite using Langgraph, Tavily, and GPT-4.☆14Updated last year
- RAG with postgreSQL(nebius) and pgvector☆24Updated 9 months ago
- ☆74Updated 11 months ago
- ☆38Updated last year
- A fun project where I use the power of AI to analyze a PDF. The AI extracts key information based on the user's instructions and selectio…☆78Updated 10 months ago
- ☆37Updated last year
- GenAI Experimentation☆57Updated last week
- Widest collection of generative ai usecases in enterprise & startups☆19Updated last year