biraj21 / web-wanderer
A multi-threaded web crawler written in Python, utilizing ThreadPoolExecutor and Playwright to efficiently crawl dynamically rendered web pages and download them.
☆21Updated 3 months ago
Alternatives and similar repositories for web-wanderer:
Users that are interested in web-wanderer are comparing it to the libraries listed below
- ☆10Updated 10 months ago
- A single-threaded TCP server with an event loop using the poll system call written in C.☆90Updated 10 months ago
- Simple orchestration for EC2 spot containers☆20Updated 6 months ago
- Pieces CLI for interacting with Pieces OS☆66Updated this week
- A Python Pieces OS SDK wrapper that allows anyone to easily create a Pieces Copilot experience with minimal code.☆10Updated 7 months ago
- The AI-powered CLI Assistant☆26Updated 10 months ago
- 𝙏𝙪𝙧𝙣𝙞𝙣𝙜 𝙨𝙢𝙖𝙡𝙡 𝙩𝙖𝙨𝙠 𝙙𝙚𝙨𝙘𝙧𝙞𝙥𝙩𝙞𝙤𝙣𝙨 𝙞𝙣𝙩𝙤 𝙢𝙚𝙜𝙖 𝙥𝙧𝙤𝙢𝙥𝙩𝙨 𝙖𝙪𝙩𝙤𝙢𝙖𝙜𝙞𝙘𝙖𝙡𝙡𝙮.☆67Updated 8 months ago
- A showcase of Phi Agent capabilities featuring a Streamlit-powered Research and Finance AI assistant built with Meta Llama 3.3 70B Instru…☆12Updated 3 months ago
- 🛤️ Pathik - High-Performance Web Crawler ⚡☆25Updated this week
- A curated list of Mintlify resources and examples.☆12Updated 4 months ago
- tsellm: LLMs in SQLite and DuckDB☆22Updated 7 months ago
- Notion Automation using Serverless and Notion API☆13Updated last year
- A beginner-friendly GitHub repo for web scraping and data processing in Python. Contribute by writing Pandas scripts, transforming code …☆9Updated last year
- Vector search over tweets from the tweet archive using OpenAI embeddings and LanceDB☆53Updated last year
- A CLI application for generating simple project boilerplates using generative AI.☆36Updated 6 months ago
- Quick script to convert a git repo into a prompt for analyzing with an LLM☆24Updated 9 months ago
- This is a lightweight agent framework for C that integrates smoothly with a variety of systems. It offers a clear and straightforward fou…☆60Updated last month
- Ask your terminal (AI) about cli commands☆16Updated 8 months ago
- Server-side logic for an LLM application to make your prose clearer and more objective.☆25Updated last year
- 🚀 A simple, modern, full-stack toolkit for Python 🐍☆36Updated 5 months ago
- Python Wrapper on top of Unofficial Medium API to quickly extract data from Medium's website.☆55Updated 2 months ago
- Sonicrypt is a compact and intuitive tool designed to enhance the user experience for both buyers and sellers engaging in crypto transact…☆11Updated 11 months ago
- An Analysis of Public PPP Loan Data To Uncover Fraud☆11Updated last month
- Chrome extension that uses Code LLama to solve LeetCode problems in Real Time☆14Updated last year
- ☆12Updated last year
- A minimal hackernews client☆15Updated 5 months ago
- Pip Package for MirageML☆25Updated last year
- Some tough questions to test new models.☆27Updated 11 months ago
- Go-based CLI tool for adding licenses to your open source projects, streamlining your workflow 🚀☆18Updated 9 months ago
- Convert a regular GPT call into a ChatGPT call☆12Updated 2 years ago