scrapfly / python-scrapfly
Scrapfly Python SDK for headless browsers and proxy rotation
☆33Updated this week
Related projects ⓘ
Alternatives and complementary repositories for python-scrapfly
- Scrapy rotation proxy package with advanced functions☆93Updated 2 years ago
- Library that helps use puppeteer in scrapy.☆51Updated last week
- Clean, filter and sample URLs to optimize data collection – Python & command-line – Deduplication, spam, content and language filters☆124Updated last week
- Python library that allows you to get structured responses in the form of Pydantic models and Python types from Anthropic, Google Vertex …☆70Updated 3 months ago
- ☆12Updated last month
- Spider ported to Python☆47Updated last month
- A simple and streamlined Python script to extract and filter links from a remote HTML resource.☆23Updated 11 months ago
- Prism is the easiest way to develop, orchestrate, and execute data pipelines in Python.☆82Updated 7 months ago
- Pare is the easiest way to deploy Python Lambdas alongside your primary web application.☆40Updated 2 months ago
- Spider templates for automatic crawlers.☆24Updated last week
- This is a proof-of-concept of using an LLM to find and extract meaningful data without parsing the html too much.☆27Updated last year
- Lightning-Fast, Adaptive Web Scraping for Python☆128Updated this week
- pai: A Python REPL with a built in AI agent☆36Updated last year
- GPTAuthor is an AI tool for writing long form, multi-chapter stories given a story prompt.☆60Updated 8 months ago
- Chatroom app where messages are sent to GPT, Claude, Mistral, Together, Groq AI and streamed to the frontend.☆37Updated last week
- Requests-HTML(with microsoft/playwright-python): HTML Parsing for Humans™☆28Updated 4 months ago
- Apify API client for Python☆47Updated this week
- Making Time Speak! 🎙️☆29Updated this week
- The faststream-gen library uses advanced AI to generate FastStream code from user descriptions, speeding up FastStream app development.☆43Updated 7 months ago
- Embedding models from Jina AI☆56Updated 9 months ago
- Dockerized FastAPI wrapper around the recognize-anything image recognition models☆25Updated 7 months ago
- Building a Concurrent Web Scraper with Python and Selenium☆35Updated 2 years ago
- Serverless for data practitioners. The fastest ⚡️ way to run your code in the cloud. Effortlessly run scripts, functions, and Jupyter not…☆38Updated 8 months ago
- Yet another Python web framework☆42Updated last month
- ipython + REPL + coroutines - suffering☆16Updated 2 months ago
- Redis Queue Dashboard based on FastAPI☆85Updated last month
- ☆41Updated last month
- Common interface for data container classes☆62Updated 3 weeks ago
- Web scraping Page Objects core library☆95Updated 3 weeks ago
- PyNLP Lib is an open source Python NLP library that provides functionality for both web and local development☆49Updated 2 years ago