I think popups and video displacement popups are blocking the scraper. When I try with both proxies and local IP I get the same results. For instance these articles will never extract no matter what settings I try. They have exit popups and videos (and good content I want).
Code:
[04:27:27] Result 01 - Unable to extract content for https://www.washingtonpost.com/opinions/global-opinions/the-fake-news-russians-hear-at-home/2018/05/04/cd1b729c-4fc9-11e8-b725-92c89fe3ca4c_story.html
[04:27:27] Result 02 - Unable to extract content for https://www.theregister.co.uk/2018/05/04/google_campaign_ads/
[04:27:27] Result 03 - Unable to extract content for https://www.theadvertiser.com/story/news/local/louisiana/2018/05/04/why-people-more-apt-believe-fake-news/582117002/
I've been noticing a lot of good content is getting skipped.