biraj21 / web-wanderer
A multi-threaded web crawler written in Python, utilizing ThreadPoolExecutor and Playwright to efficiently crawl dynamically rendered web pages and download them.
☆21Updated 2 months ago
Alternatives and similar repositories for web-wanderer:
Users that are interested in web-wanderer are comparing it to the libraries listed below
- Simple orchestration for EC2 spot containers☆20Updated 4 months ago
- ☆10Updated 9 months ago
- Vector search over tweets from the tweet archive using OpenAI embeddings and LanceDB☆54Updated 10 months ago
- In this repository I have a code and brief explanations of the attempts that I made at the ARC-AGI (2024) challenges :)☆23Updated 3 months ago
- Intro to leetcodes. Basic techniques, quicksort and hash structures implementation, space and time complexities.☆96Updated 6 months ago
- An OS entirely coded by ChatGPT☆17Updated last year
- A minimal hackernews client☆15Updated 4 months ago
- A single-threaded TCP server with an event loop using the poll system call written in C.☆90Updated 9 months ago
- ☆38Updated 7 months ago
- a simple numpy alternative in C☆22Updated 4 months ago
- A browser extension that brings X/Twitter's Community Notes to every website.☆34Updated 8 months ago
- A curated list of Mintlify resources and examples.☆12Updated 3 months ago
- An automation tool that helps students and researchers write personalized cold emails to professors for research positions. The tool uses…☆23Updated 3 months ago
- Automatically pass your funcions defined in Python to ChatGPT have it call them back seemlessly.☆13Updated last year
- pipeline to auto (scrape => clean => analyze => chat with) tons of data☆42Updated 8 months ago
- Analyzing hacker news in real-time with Bytewax and Proton☆39Updated last year
- A showcase of Phi Agent capabilities featuring a Streamlit-powered Research and Finance AI assistant built with Meta Llama 3.3 70B Instru…☆12Updated 2 months ago
- Convert a regular GPT call into a ChatGPT call☆12Updated last year
- This repo lets you run mistral-7b in Google Colab.☆16Updated last year
- A couple scripts to grab stats from email☆41Updated 5 months ago
- My solutions for Advanced Python Mastery (course by @dabeaz)☆11Updated last year
- Run transcriptions using the OpenAI Whisper API☆20Updated 3 months ago
- buildingggggggg 🐳☆20Updated 5 months ago
- Use GPTparser with your OpenAI API to scrape & parse files into structured JSON files.☆13Updated 10 months ago
- never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…☆37Updated 9 months ago
- ☆16Updated 6 months ago
- Server-side logic for an LLM application to make your prose clearer and more objective.☆25Updated last year
- A fully autonomous AI artist☆18Updated last year
- Tasks as HTTP endpoints☆27Updated 7 months ago