Scrapebox on Password Protected Websites

Discussion in 'Black Hat SEO' started by OnticStein, May 30, 2017.

  1. OnticStein

    OnticStein Newbie

    Joined:
    Mar 12, 2013
    Messages:
    13
    Likes Received:
    7
    Hello,
    I'm currently trying to scrape data from 5 webpages that require a log in for access to the information. When I load the URL's into Scrapebox - it doesn't scrape properly due to the login requirement - does anyone have experience on how to navigate around this? I have the log in information for the website - I just don't know how to navigate it. Thanks.
     
  2. Ste Fishkin

    Ste Fishkin BANNED BANNED

    Joined:
    May 14, 2011
    Messages:
    2,051
    Likes Received:
    8,021
    You can do this with screaming frog.

    I'm not sure scrapebox supports password protected pages.
     
    • Thanks Thanks x 4
  3. OnticStein

    OnticStein Newbie

    Joined:
    Mar 12, 2013
    Messages:
    13
    Likes Received:
    7
    Do you know if you can on the free version of screaming frog?
     
  4. Ste Fishkin

    Ste Fishkin BANNED BANNED

    Joined:
    May 14, 2011
    Messages:
    2,051
    Likes Received:
    8,021
    Why don't you check their website. I'm not a frog salesman.
     
    • Thanks Thanks x 5
  5. loopline

    loopline Jr. VIP Jr. VIP

    Joined:
    Jan 25, 2009
    Messages:
    4,139
    Likes Received:
    2,207
    Gender:
    Male
    Home Page:
    Scrapebox does not support authentication, so you can't do this.
     
    • Thanks Thanks x 1
  6. OnticStein

    OnticStein Newbie

    Joined:
    Mar 12, 2013
    Messages:
    13
    Likes Received:
    7
    I've been using a Chrome extension called "Advanced Web Scraper" that seems to be working well with login authentication.
     
  7. tdwuk

    tdwuk Newbie

    Joined:
    Mar 16, 2018
    Messages:
    10
    Likes Received:
    2
    Gender:
    Male
    Hi,
    I just purchased scrapebox and want to do the same thing, scrape data from a site that is password protected. It is a legit site but they don't have any form of data export yet. Does Scrapebox 2.0 work for this? I will checkout the other 2 suggestions. Thanks.
     
  8. MikeyMikey13

    MikeyMikey13 Elite Member

    Joined:
    May 25, 2014
    Messages:
    2,107
    Likes Received:
    778
    Location:
    Walford
     
  9. loopline

    loopline Jr. VIP Jr. VIP

    Joined:
    Jan 25, 2009
    Messages:
    4,139
    Likes Received:
    2,207
    Gender:
    Male
    Home Page:
    No, scrapebox does not support authentication, so no it won't work for a site where you have to be logged in.