drogbadvc / crawlit
This project is a web crawler based on Scrapy, visualization 2D, PageRank
☆25Updated last year
Alternatives and similar repositories for crawlit:
Users that are interested in crawlit are comparing it to the libraries listed below
- Python wrapper for the Bing Webmaster Tools API☆17Updated last week
- SEMRush SERP Tutorial. Using advertools to Extract and Analyze Search Engine Results Pages Data☆14Updated 6 years ago
- Exploring what's possible with the ChatGPT Code Interpreter and how to use it effectively☆11Updated last year
- Streamlit Connection for querying Openai embeddings☆11Updated last year
- URL Inspection Tool Automator☆24Updated 2 years ago
- Scraping Wikipedia by combining LangChain's agents and tools with OpenAI's LLMs and function calling☆26Updated last year
- ☆10Updated 6 months ago
- Project automates AI news gathering and Blog post Writing. Our AI agent collects insights and news about any topic From Internet and Wri…☆22Updated 9 months ago
- Productivity Booster apps powered by GenAI☆28Updated last year
- If you want a quick and dirty way to programmatically meta descriptions at scale using Python, this is the tutorial for you. Jupyter note…☆18Updated 3 years ago
- advertools crawler UI☆28Updated 2 years ago
- A website built in Streamlit to sell digital products. The payment gateway will be Stripe.☆52Updated 6 months ago
- ☆47Updated 4 months ago
- ☆45Updated last year
- SEO audit and analysis template with Python and advertools☆31Updated last year
- Automate lead research, qualification, and outreach with AI agents and Langgraph, creating personalized messaging and connecting with you…☆55Updated 2 weeks ago
- docs and examples of streamlit-shadcn-ui☆45Updated 8 months ago
- ☆14Updated 7 months ago
- Example LangGraph flow that does "competitor analysis" on the web.☆21Updated 7 months ago
- Building Essence Towards Personalized Knowledge Model - PKM☆27Updated 3 months ago
- This project experiments with the Google NLP Algorithm to evaluate e-commerce product descriptions from an SEO perspective.☆17Updated 4 years ago
- Scan resumes and extract important details using OpenAI functions☆20Updated last year
- AI Chat Widget - flexible and lite chat widget that can connect to OpenAI Assistant, any database, tools☆44Updated 8 months ago
- Run multiple Lighthouse reports for different URLs and see how well your URLs are performing separately. Get Overall Performance, Accessi…☆38Updated last year
- ☆19Updated 8 months ago
- This repository shows how to create personalized emails in bulk using Open AI ChatGPT API and web scrapping.☆21Updated last year
- ☆13Updated 3 weeks ago
- ☆28Updated 3 months ago
- A chatbot demo that scrapes a website and stores the result in a vector db, which can then be queried via natual language - chatgpt style…☆33Updated last year