I need assistance with a Python script. When it opens a link in Chrome, the code seems not scrape anithing . Can someone help me

vittorianicolosi1994

Regular Member
Joined
Jan 17, 2024
Messages
279
Reaction score
81
i cannot scrape the website due the " privacy and trasparency accept to continue (image ) .
it should scrapes website ,it is python code use selenium undetected chromedriver


I was new to web scraping and I was trying to create a scraper which scarpe data and otput json file.


It 's not worked. But idk the problem
Duelingbook - Deck - Google Chrome 11_03_2025 11_11_21.png
 
use bs4 (BeautifulSoup) to parser html
Python:
html = bs4(driver.page_source, "html.parser")
 
Been there, man. Try adding a try/except block to specifically handle that popup – might need to find the accept button element and click it before proceeding with the scrape.
 
maybe that popup is just a modal which gets visible after the website has loaded, and with the click it gets invisible...
Have you checked if the rest of the page is available even if the popup is open, maybe?
 
Back
Top