biraj21 / web-wanderer
A multi-threaded web crawler written in Python, utilizing ThreadPoolExecutor and Playwright to efficiently crawl dynamically rendered web pages and download them.
☆21Updated 4 months ago
Alternatives and similar repositories for web-wanderer:
Users that are interested in web-wanderer are comparing it to the libraries listed below
- Simple orchestration for EC2 spot containers☆20Updated 6 months ago
- A minimal hackernews client☆16Updated 6 months ago
- A prompt management, versioning, testing, and evaluation inference server and UI toolkit. Provider agnostic and OpenAI API compatible.☆57Updated 3 weeks ago
- Neural Networks from scratch in Go.☆21Updated 9 months ago
- A single-threaded TCP server with an event loop using the poll system call written in C.☆90Updated 11 months ago
- Notion Automation using Serverless and Notion API☆13Updated last year
- ☆10Updated 11 months ago
- Chrome extension that uses Code LLama to solve LeetCode problems in Real Time☆14Updated last year
- Linux container from scratch in Go using Ubuntu 22.04 rootfs.☆41Updated 5 months ago
- Prompt-based software development☆23Updated 7 months ago
- Low Level LLM benchmark☆64Updated 2 months ago
- literally just cool looking countdowns☆66Updated 2 weeks ago
- Vector search over tweets from the tweet archive using OpenAI embeddings and LanceDB☆53Updated last year
- A script written in Python to get your Spotify stats like top artists, songs, albums & more :)☆34Updated last year
- This library provides you with an easy way to create and run Hive Agents.☆16Updated 5 months ago
- A showcase of Phi Agent capabilities featuring a Streamlit-powered Research and Finance AI assistant built with Meta Llama 3.3 70B Instru…☆12Updated 4 months ago
- A CLI application for generating simple project boilerplates using generative AI.☆39Updated 7 months ago
- A browser extension that brings X/Twitter's Community Notes to every website.☆35Updated 9 months ago
- MCP remote server for AI Engineer World's Fair 2025☆12Updated this week
- LangChain + LiteLLM that works☆39Updated last week
- translation Python source into C.☆13Updated 5 months ago
- Polar SDK for Python☆22Updated this week
- pipeline to auto (scrape => clean => analyze => chat with) tons of data☆40Updated 10 months ago
- A Chrome extension that replaces all images on Youtube.com with pictures of Bob Ross.☆39Updated 5 months ago
- MongoDB + Haize = Safe & Secure RAG with RBAC☆12Updated 6 months ago
- Uses Twitter archive to visualize your Twitter network based on your replies, quote tweets and direct messaging history. Get DM stats wit…☆130Updated 10 months ago
- The Pieces OS Client SDK is a powerful code engine package designed for writing applications on top of Pieces OS.☆29Updated last month
- Convert a regular GPT call into a ChatGPT call☆14Updated 2 years ago
- a Python client for the Neon API☆17Updated last month
- Rust Implementation of micrograd☆51Updated 9 months ago