biraj21 / web-wanderer
A multi-threaded web crawler written in Python, utilizing ThreadPoolExecutor and Playwright to efficiently crawl dynamically rendered web pages and download them.
☆21Updated last month
Alternatives and similar repositories for web-wanderer:
Users that are interested in web-wanderer are comparing it to the libraries listed below
- ☆10Updated 8 months ago
- A minimal hackernews client☆15Updated 3 months ago
- Flawa generates Markdown docs from code files, so you don’t have to explain everything.☆15Updated 2 months ago
- Go-based CLI tool for adding licenses to your open source projects, streamlining your workflow 🚀☆18Updated 7 months ago
- ☆12Updated last year
- Rebuild complex systems from scratch☆66Updated this week
- Pin files for contextual, codebase-level AI assistance.☆15Updated 6 months ago
- Automated dataframe analysis for Machine Learning pipelines.☆11Updated 8 months ago
- LangChain + LiteLLM that works☆28Updated this week
- download and view the contents of a GitHub repository or a ZIP file as a single text file☆39Updated 5 months ago
- A showcase of Phi Agent capabilities featuring a Streamlit-powered Research and Finance AI assistant built with Meta Llama 3.3 70B Instru…☆12Updated last month
- A CLI application for generating simple project boilerplates using generative AI.☆33Updated 4 months ago
- Simple orchestration for EC2 spot containers☆20Updated 3 months ago
- Extract structured data from any unstructured web page☆40Updated 9 months ago
- Graphical Code Tracer (GCT): Visualize code at lightning speed☆52Updated 6 months ago
- This library provides you with an easy way to create and run Hive Agents.☆15Updated 2 months ago
- Convert a regular GPT call into a ChatGPT call☆12Updated last year
- Neural Networks from scratch in Go.☆21Updated 6 months ago
- A fully autonomous AI artist☆18Updated last year
- Deploy your autonomous agents to production grade environments with 99% Uptime Guarantee, Infinite Scalability, and self-healing.☆32Updated 3 weeks ago
- Some tough questions to test new models.☆26Updated 8 months ago
- We Replicate Research Papers in the field of AI & ML.☆18Updated 5 months ago
- Super performant RAG pipeline for AI apps.☆15Updated 10 months ago
- 🧠 Mem4AI: A LLM Friendly memory management library.☆15Updated 2 months ago
- Analyzing hacker news in real-time with Bytewax and Proton☆38Updated 11 months ago
- Recreating gpt-2 from scratch☆18Updated 6 months ago
- 𝙏𝙪𝙧𝙣𝙞𝙣𝙜 𝙨𝙢𝙖𝙡𝙡 𝙩𝙖𝙨𝙠 𝙙𝙚𝙨𝙘𝙧𝙞𝙥𝙩𝙞𝙤𝙣𝙨 𝙞𝙣𝙩𝙤 𝙢𝙚𝙜𝙖 𝙥𝙧𝙤𝙢𝙥𝙩𝙨 𝙖𝙪𝙩𝙤𝙢𝙖𝙜𝙞𝙘𝙖𝙡𝙡𝙮.☆53Updated 5 months ago
- a Python client for the Neon API☆16Updated this week
- Notion Automation using Serverless and Notion API☆13Updated last year