codelucas / newspaper

Related projects ⓘ

Alternatives and complementary repositories for newspaper

• buriy / python-readability
  fast python port of arc90's readability tool, updated to match latest readability.js!
  ☆2,667Updated last month
• grangier / python-goose
  Html Content / Article Extractor, web scrapping lib in Python
  ☆3,984Updated 2 years ago
• binux / pyspider
  A Powerful Spider(Web Crawler) System in Python.
  ☆16,502Updated 6 months ago
• fhamborg / news-please
  news-please - an integrated web crawler and information extractor for news that just works
  ☆2,095Updated last month
• scrapinghub / portia
  Visual scraping for Scrapy
  ☆9,303Updated 4 months ago
• miso-belica / sumy
  Module for automatic summarization of text documents and HTML pages.
  ☆3,524Updated 6 months ago
• sloria / TextBlob
  Simple, Pythonic, text processing--Sentiment analysis, part-of-speech tagging, noun phrase extraction, translation, and more.
  ☆9,159Updated this week
• clips / pattern
  Web mining module for Python, with tools for scraping, natural language processing, machine learning, network analysis and visualization.
  ☆8,753Updated 5 months ago
• dragnet-org / dragnet
  Just the facts -- web page content extraction
  ☆1,254Updated 4 months ago
• deanmalmgren / textract
  extract text from any document. no muss. no fuss.
  ☆3,910Updated this week
• goose3 / goose3
  A Python 3 compatible version of goose http://goose3.readthedocs.io/en/latest/index.html
  ☆831Updated 3 months ago
• scrapy / scrapy
  Scrapy, a fast high-level web crawling & scraping framework for Python.
  ☆53,202Updated this week
• aivarsk / scrapy-proxies
  Random proxy middleware for Scrapy
  ☆1,658Updated 5 years ago
• DormyMo / SpiderKeeper
  admin ui for scrapy/open source scrapinghub
  ☆2,741Updated last year
• scrapy-plugins / scrapy-splash
  Scrapy+Splash for JavaScript integration
  ☆3,157Updated last year
• seatgeek / fuzzywuzzy
  Fuzzy String Matching in Python
  ☆9,229Updated last year
• rq / rq
  Simple job queues for Python
  ☆9,895Updated this week
• amueller / word_cloud
  A little word cloud generator in Python
  ☆10,176Updated last week
• geekan / scrapy-examples
  Multifarious Scrapy examples. Spiders for alexa / amazon / douban / douyu / github / linkedin etc.
  ☆3,180Updated last year
• kennethreitz / records
  SQL for Humans™
  ☆7,163Updated 4 months ago
• rmax / scrapy-redis
  Redis-based components for Scrapy.
  ☆5,536Updated 4 months ago
• lorien / grab
  Web Scraping Framework
  ☆2,393Updated 8 months ago
• saffsd / langid.py
  Stand-alone language identification system
  ☆2,324Updated 4 years ago
• euske / pdfminer
  Python PDF Parser (Not actively maintained). Check out pdfminer.six.
  ☆5,256Updated last year
• Alir3z4 / html2text
  Convert HTML to Markdown-formatted text.
  ☆1,847Updated 3 months ago
• MechanicalSoup / MechanicalSoup
  A Python library for automating interaction with websites.
  ☆4,673Updated this week
• jmcarp / robobrowser
  ☆3,702Updated 4 years ago
• DerwenAI / pytextrank
  Python implementation of TextRank algorithms ("textgraphs") for phrase extraction
  ☆2,150Updated 4 months ago
• aboSamoor / polyglot
  Multilingual text (NLP) processing toolkit
  ☆2,316Updated last year
• scrapy / scrapyd
  A service daemon to run Scrapy spiders
  ☆2,970Updated last week