biraj21 / web-wanderer
A multi-threaded web crawler written in Python, utilizing ThreadPoolExecutor and Playwright to efficiently crawl dynamically rendered web pages and download them.
☆20Updated 6 months ago
Related projects ⓘ
Alternatives and complementary repositories for web-wanderer
- Notion Automation using Serverless and Notion API☆13Updated last year
- Flawa generates Markdown docs from code files, so you don’t have to explain everything.☆12Updated this week
- Python Wrapper on top of Unofficial Medium API to quickly extract data from Medium's website.☆48Updated 3 months ago
- A single-threaded TCP server with an event loop using the poll system call written in C.☆88Updated 6 months ago
- Linux container from scratch in Go using Ubuntu 22.04 rootfs.☆39Updated last week
- literally just cool looking countdowns☆49Updated 2 months ago
- Vector search over tweets from the tweet archive using OpenAI embeddings and LanceDB☆54Updated 7 months ago
- Simple orchestration for EC2 spot containers☆19Updated last month
- Summarize and ask questions about items in the Internet Archive☆16Updated last year
- A script written in Python to get your Spotify stats like top artists, songs, albums & more :)☆32Updated 11 months ago
- User-friendly WebUI for LLMs☆21Updated 5 months ago
- Pieces CLI for interacting with Pieces OS☆58Updated last week
- Graphical Code Tracer (GCT): Visualize code at lightning speed☆52Updated 4 months ago
- Extract structured data from any unstructured web page☆40Updated 7 months ago
- RAG on codebases using treesitter and LanceDB☆31Updated this week
- A couple scripts to grab stats from email☆40Updated 2 months ago
- An example implementation of the slack-gpt starter which ingests confluence pages to create a helpful slack bot☆23Updated last year
- Go-based CLI tool for adding licenses to your open source projects, streamlining your workflow 🚀☆18Updated 5 months ago
- Talk to GPT in Vim!☆13Updated last month
- buildingggggggg 🐳☆17Updated 2 months ago
- Neural Networks from scratch in Go.☆21Updated 4 months ago
- Extensive introductory writeup on Zig language functionalities☆10Updated 4 months ago
- ChatGPT Plugin to Semantically Search Google Maps☆46Updated last year
- Project Aware Coding Assistant using the OpenAI/Google API.☆10Updated 4 months ago
- A collection of scripts to "help" you with your programming exams and assignments.☆16Updated 10 months ago
- Hacker News AI Search☆31Updated 7 months ago
- My solutions for Advanced Python Mastery (course by @dabeaz)☆12Updated 9 months ago
- ☆18Updated 2 months ago
- A vim-like terminal reader to chat with your books☆25Updated last week
- ☆41Updated 4 months ago