1. This website uses cookies to improve service and provide a tailored user experience. By using this site, you agree to this use. See our Cookie Policy.
    Dismiss Notice

ScrapeBox does not see AJAX?

Discussion in 'Black Hat SEO Tools' started by callmemaximillian, Mar 27, 2019.

?

Can ScrapeBox scrape from AJAX websites?

  1. Yes

    1 vote(s)
    20.0%
  2. Well... No

    4 vote(s)
    80.0%
  1. callmemaximillian

    callmemaximillian Newbie

    Joined:
    Feb 9, 2016
    Messages:
    23
    Likes Received:
    3
    Gender:
    Male
    I looked through the forum wanted to figure out, how can handle websites, where AJAX is used (you will not see data in the source code) and found the thread:

    https://www.blackhatworld.com/seo/scrapebox-the-ultimate-serp-scraper-auto-blog-commenter-with-prstorm-mode.129096/page-919#post-9376157

    Maybe did someone had the experience with that? Can we handle AJAX websites with the ScrapeBox to scrape the data?o_O
     
  2. GoGuerilla

    GoGuerilla Jr. VIP Jr. VIP

    Joined:
    Oct 15, 2018
    Messages:
    215
    Likes Received:
    92
    You could rig something up using selenium pretty easily, although sockets is much much faster.

    How much data do you need to scrape?
     
  3. Greasedonkey

    Greasedonkey Registered Member

    Joined:
    Mar 27, 2018
    Messages:
    94
    Likes Received:
    20
    I did not have success when scraping javascript sites
     
  4. callmemaximillian

    callmemaximillian Newbie

    Joined:
    Feb 9, 2016
    Messages:
    23
    Likes Received:
    3
    Gender:
    Male
    Thanks for the reply, actually it was a test, wanted to figure out if ScrapeBox can handle AJAX itself. Just couple of the websites, will learn Selenium, think that it will be helpful. Also found information about Octoparse (think could be useful for smal projects)
     
  5. Lauren11

    Lauren11 Registered Member

    Joined:
    Nov 21, 2018
    Messages:
    86
    Likes Received:
    13
    Gender:
    Female
    Scrapebox dont have ability to scrape data that is behind js or using js. Other than that it can scrape anything. I don't understand why scrapebox team didn't updated this still after all these years. What you want to scrape exactly?
     
  6. kveldulv

    kveldulv Junior Member

    Joined:
    Aug 19, 2009
    Messages:
    199
    Likes Received:
    78
    Location:
    Ho Chi Minh, Vietnam
    Scrapebox can't scrape pages that are generated on the fly, after the page has loaded. So basically, not it can't scrape AJAX pages.
     
  7. loopline

    loopline Jr. VIP Jr. VIP

    Joined:
    Jan 25, 2009
    Messages:
    4,833
    Likes Received:
    2,590
    Gender:
    Male
    Home Page:
    As noted above Scrapebox uses raw sockets and threads. By convention these do not support scripts, javascript, ajax etc...

    So scrapebox sees the internet as a browser with scripts turned off. Many sites will have no script versions of the site, but not all sites do this. So if the content is rendered with scripts off then scrapebox can see it, so you can turn off javascript in your browser and then load the page and look at the source.

    Take note that often times a lot of content if not all of it is still in the source with javascript off, but many times the browser will just display a blank page even if the content is there and even if scrapebox can scrape it. So look at the html source.