ncouture / python-search-engineLinks
Search engine base (crawler, indexer and parser) using Python, Celery, RabbitMQ, CouchDB and Whoosh.
☆11Updated last month
Alternatives and similar repositories for python-search-engine
Users that are interested in python-search-engine are comparing it to the libraries listed below
Sorting:
- A Flask full-text search engine☆83Updated 5 years ago
- A language for filtering, matching, and validating Python dictionaries☆47Updated last year
- PyQuery-based scraping micro-framework.☆117Updated 3 years ago
- Want to handle 100,000 messages in 90 seconds? Celery and Kombu are that awesome - Multiple publisher-subscriber demos for processing jso…☆41Updated 6 years ago
- Taking a screenshot of a webpage.☆48Updated 9 years ago
- Supervisor On/Off: an alternative web interface for supervisor☆50Updated 8 years ago
- 🕷Configuration based html scraper☆23Updated 4 months ago
- Bringing sanity to world of messed-up data☆66Updated 10 years ago
- Python implementation of the Parsley language for extracting structured data from web pages☆92Updated 7 years ago
- Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations☆40Updated last year
- Create scheduled tasks at runtime easily (Django, Flask, Bottle etc.)☆45Updated 9 years ago
- A middleware to use random user agent in Scrapy crawler.☆33Updated 12 years ago
- Jabba's headless webkit browser for scraping AJAX-powered webpages.☆91Updated 10 years ago
- Find which links on a web page are pagination links☆29Updated 8 years ago
- Minimalist Selenium WebDriver wrapper to work within rate limits of any amount of websites simultaneously. Parallel processing friendly.☆51Updated 8 years ago
- Python SMTP client and Email for Humans™☆82Updated 6 years ago
- One interface to read and write the data in various excel formats, import the data into and export the data from databases☆60Updated 4 months ago
- Turn your IPython console into a cross-database SQL client☆31Updated 9 years ago
- Some scrapy and web.py exmaples☆79Updated 8 years ago
- A/B testing for your Flask application.☆121Updated 5 years ago
- Small set of utilities to simplify writing Scrapy spiders.☆49Updated 10 years ago
- A Content Management System for Flask☆39Updated 10 years ago
- Minimal, prototype RESTful server for basic CRUD transactions☆38Updated 8 years ago
- Restrict crawl and scraping scope using matchers.☆26Updated 9 years ago
- A high-performance distributed web crawling & scraping framework written with golang and python.☆30Updated 9 years ago
- dank key/value store high-level APIs☆18Updated 7 years ago
- Flask extension providing integration with the Neo4j graph database.☆57Updated 4 years ago
- Assorted generic flask views, blueprints, Jinja2 filters, macros, forms and more.☆24Updated 5 years ago
- ☕🗄CAching Proxy in Python – Simple file based python http proxy☆15Updated 3 years ago
- Python3 SOAP client built with lxml and requests.☆43Updated 4 years ago