Batch/automatic uncovering "hidden" elements which appear after you click

Pete Friedman

Regular Member
Joined
Apr 6, 2015
Messages
357
Reaction score
159
Hello :)
There's a site I want to scrap for some data but the data is not immediately visibile after you load the webpage - to uncover the data you need to click on a button (probably some JavaScript, not a HTML button unfortunately) and then the data appears. There are many such fields on the site.
What ways can you think of to help me accomplish my task? I'd like to write a short script for that, preferably in Python.
 
You can use selenium or headless browsers like phantomjs or casperjs. Both can be controlled using Python.
 
Back
Top