1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

How to scrape div content with Scrapebox?

Discussion in 'Black Hat SEO Tools' started by dsan996, May 10, 2015.

  1. dsan996

    dsan996 Regular Member

    Joined:
    Apr 18, 2014
    Messages:
    285
    Likes Received:
    140
    Location:
    Depends on the day
    Hi, I have this website with hundreds of pages. There is a div in every page with the same html id but different text inside. Is there a way to scrape the text inside every div in the site by using Scrapebox?

    I know that there is the Page Scanner addon, but it doesn't return the tag content (only tells if the tag is in the page or not).
     
  2. Repulsor

    Repulsor Power Member

    Joined:
    Jun 11, 2013
    Messages:
    770
    Likes Received:
    279
    Location:
    PHP Scripting ;)
    Your best bet is to get the whole url list using scrapebox, and have a script,php or python or any program fetch the content(html) and parse the html to get you the content you are looking for. In this case, the content inside the div.

    I dont think scrapebox can really dom parse the html and get you the required content. As you said page scanner can check the existence, as its prime function is/was to detect the platform.
     
    • Thanks Thanks x 1
  3. loopline

    loopline Jr. VIP Jr. VIP

    Joined:
    Jan 25, 2009
    Messages:
    3,849
    Likes Received:
    2,043
    Gender:
    Male
    Home Page:
    Sure, you can use the comment grabber in V2.0. I scraped a bunch of contact info this week from directories using it.
     
    • Thanks Thanks x 1
  4. dsan996

    dsan996 Regular Member

    Joined:
    Apr 18, 2014
    Messages:
    285
    Likes Received:
    140
    Location:
    Depends on the day
    Thanks a bunch loopline, that did the trick. The new version of Scrapebox looks very nice by the way.
     
  5. loopline

    loopline Jr. VIP Jr. VIP

    Joined:
    Jan 25, 2009
    Messages:
    3,849
    Likes Received:
    2,043
    Gender:
    Male
    Home Page:
    Glad you like it. :) I don't work for Scrapebox but the more happy customers, the better it is for all of us. Glad that worked too.
     
  6. Atomic76

    Atomic76 Registered Member

    Joined:
    May 24, 2014
    Messages:
    67
    Likes Received:
    37
    This would be a great video tutorial topic btw, if you haven't already done one on it.
     
  7. loopline

    loopline Jr. VIP Jr. VIP

    Joined:
    Jan 25, 2009
    Messages:
    3,849
    Likes Received:
    2,043
    Gender:
    Male
    Home Page:
    I plan to make a video on it, in fact they are developing a general content scraper. Under grab/check >> custom data scraper. So I will do a video on it with that, its on the mental list.