btimby / fulltext

Related projects ⓘ

Alternatives and complementary repositories for fulltext

• seomoz / url-py
  URL Transformation, Sanitization
  ☆103Updated 9 months ago
• pudo / normality
  A tiny library for Python text normalisation. Useful for ad-hoc text processing.
  ☆144Updated 10 months ago
• scrapinghub / page_finder
  Find which links on a web page are pagination links
  ☆29Updated 7 years ago
• alephdata / countrynames
  Utility library to turn country names into ISO two-letter codes
  ☆66Updated 3 weeks ago
• Alir3z4 / python-sanitize
  Bringing sanity to world of messed-up data
  ☆65Updated 10 years ago
• dfm / feedfinder2
  A Python library for finding feed links on websites.
  ☆50Updated 2 years ago
• TeamHG-Memex / autologin-middleware
  Scrapy middleware for the autologin
  ☆37Updated 6 years ago
• scoder / acora
  Fast multi-keyword search engine for text strings
  ☆247Updated last month
• scrapinghub / aile
  Automatic Item List Extraction
  ☆87Updated 8 years ago
• stefanw / scrapa
  Python 3 AsyncIO powered scraping framework with batteries included
  ☆20Updated 8 years ago
• redapple / parslepy
  Python implementation of the Parsley language for extracting structured data from web pages
  ☆92Updated 7 years ago
• Mimino666 / python-xextract
  Extract structured data from HTML and XML documents like a boss.
  ☆50Updated last year
• matiasb / demiurge
  PyQuery-based scraping micro-framework.
  ☆113Updated 2 years ago
• xmonader / python-sonic-client
  sonic search backend client in python
  ☆60Updated 3 years ago
• lethain / extraction
  A Python library for extracting titles, images, descriptions and canonical urls from HTML.
  ☆148Updated 4 years ago
• scrapy-plugins / scrapy-magicfields
  Scrapy middleware to add extra fields to items, like timestamp, response fields, spider attributes etc.
  ☆56Updated 2 years ago
• scrapy / pypydispatcher
  A fork of http://pydispatcher.sourceforge.net/ with PyPy support
  ☆16Updated 7 years ago
• moshe / asonic
  async python client for the sonic search backend
  ☆130Updated 4 years ago
• llonchj / scrapy-sentry
  Sentry component for Scrapy
  ☆86Updated last year
• pydepta / pydepta
  A python implementation of DEPTA
  ☆83Updated 7 years ago
• kserhii / money-parser
  Price and currency parsing utility
  ☆26Updated last year
• Lispython / human_curl
  Simple Human wrapper for cURL library
  ☆205Updated 3 years ago
• scrapinghub / webpager
  Paginating the web
  ☆37Updated 10 years ago
• TeamHG-Memex / autopager
  Detect and classify pagination links
  ☆98Updated 4 years ago
• TeamHG-Memex / scrapy-kafka-export
  Scrapy extension which writes crawled items to Kafka
  ☆30Updated 6 years ago
• TeamHG-Memex / url-summary
  Show summary of a large number of URLs in a Jupyter Notebook
  ☆17Updated 3 years ago
• andreasvc / pyre2
  Python wrapper for RE2
  ☆99Updated last month
• scrapy-plugins / scrapy-splitvariants
  Scrapy spider middleware to split an item into multiple items using a multi-valued key
  ☆20Updated 7 years ago
• naiquevin / lookupy
  Django QuerySet like interface to query simple Python collections
  ☆67Updated last year
• stefano / pyduktape
  Embed the Duktape JS interpreter in Python
  ☆81Updated last year