biraj21 / web-wandererLinks
A multi-threaded web crawler written in Python, utilizing ThreadPoolExecutor and Playwright to efficiently crawl dynamically rendered web pages and download them.
☆22Updated 7 months ago
Alternatives and similar repositories for web-wanderer
Users that are interested in web-wanderer are comparing it to the libraries listed below
Sorting:
- A fully autonomous AI artist☆18Updated 2 years ago
- Convert a regular GPT call into a ChatGPT call☆14Updated 2 years ago
- Server-side logic for an LLM application to make your prose clearer and more objective.☆27Updated last year
- Pin files for contextual, codebase-level AI assistance.☆16Updated last year
- A curated list of Mintlify resources and examples.☆15Updated 7 months ago
- ☆19Updated 11 months ago
- ☆10Updated last year
- An OS entirely coded by ChatGPT☆17Updated last year
- Simple orchestration for EC2 spot containers☆19Updated 9 months ago
- A prompt management, versioning, testing, and evaluation inference server and UI toolkit. Provider agnostic and OpenAI API compatible.☆114Updated 3 weeks ago
- Create an LLM XML context document from an llms.txt file☆21Updated 10 months ago
- A python script to loop through urls in a csv and look for specific keywords on the scraped homepage.☆16Updated 2 years ago
- 𝙏𝙪𝙧𝙣𝙞𝙣𝙜 𝙨𝙢𝙖𝙡𝙡 𝙩𝙖𝙨𝙠 𝙙𝙚𝙨𝙘𝙧𝙞𝙥𝙩𝙞𝙤𝙣𝙨 𝙞𝙣𝙩𝙤 𝙢𝙚𝙜𝙖 𝙥𝙧𝙤𝙢𝙥𝙩𝙨 𝙖𝙪𝙩𝙤𝙢𝙖𝙜𝙞𝙘𝙖𝙡𝙡𝙮.☆83Updated 11 months ago
- GPT4 based personalized ArXiv paper assistant bot☆10Updated last year
- Pieces CLI for interacting with Pieces OS☆83Updated this week
- ☆13Updated last year
- claude-browser☆19Updated 5 months ago
- LangChain + LiteLLM that works☆44Updated last month
- A lightweight code assistant with tool-using capabilities built on HuggingFace's smolagents.☆34Updated last month
- Python SDK for Novu - The open-source notification infrastructure for engineers. 🚀☆79Updated 8 months ago
- AI search engine in 100 LOC☆50Updated last year
- Polar SDK for Python☆32Updated this week
- ☆12Updated last year
- A swarm of LLM agents that will help you test, document, and productionize your code!☆17Updated 2 weeks ago
- Git scrapers for scraping the fediverse☆17Updated this week
- ChatGPT-3-Tokenizer is tokenizer which calculates tokens and price of input query.☆15Updated 2 years ago
- The AI-powered CLI Assistant☆28Updated last year
- Automatically pass your funcions defined in Python to ChatGPT have it call them back seemlessly.☆13Updated 2 years ago
- 🛤️ Pathik - High-Performance Web Crawler ⚡☆26Updated 3 months ago
- Super performant RAG pipeline for AI apps.☆17Updated last year