How to scrape div content with Scrapebox?

dsan996 · May 10, 2015

Hi, I have this website with hundreds of pages. There is a div in every page with the same html id but different text inside. Is there a way to scrape the text inside every div in the site by using Scrapebox?

I know that there is the Page Scanner addon, but it doesn't return the tag content (only tells if the tag is in the page or not).

Repulsor · May 10, 2015

Your best bet is to get the whole url list using scrapebox, and have a script,php or python or any program fetch the content(html) and parse the html to get you the content you are looking for. In this case, the content inside the div.

I dont think scrapebox can really dom parse the html and get you the required content. As you said page scanner can check the existence, as its prime function is/was to detect the platform.

loopline · May 10, 2015

dsan996 said:
Hi, I have this website with hundreds of pages. There is a div in every page with the same html id but different text inside. Is there a way to scrape the text inside every div in the site by using Scrapebox?

I know that there is the Page Scanner addon, but it doesn't return the tag content (only tells if the tag is in the page or not).

Sure, you can use the comment grabber in V2.0. I scraped a bunch of contact info this week from directories using it.

dsan996 · May 12, 2015

loopline said:
Sure, you can use the comment grabber in V2.0. I scraped a bunch of contact info this week from directories using it.

Thanks a bunch loopline, that did the trick. The new version of Scrapebox looks very nice by the way.

loopline · May 12, 2015

dsan996 said:
Thanks a bunch loopline, that did the trick. The new version of Scrapebox looks very nice by the way.

Glad you like it.

I don't work for Scrapebox but the more happy customers, the better it is for all of us. Glad that worked too.

Atomic76 · Jul 4, 2015

loopline said:
Glad you like it. I don't work for Scrapebox but the more happy customers, the better it is for all of us. Glad that worked too.

This would be a great video tutorial topic btw, if you haven't already done one on it.

loopline · Jul 4, 2015

I plan to make a video on it, in fact they are developing a general content scraper. Under grab/check >> custom data scraper. So I will do a video on it with that, its on the mental list.

calrnnn · Aug 21, 2021

dsan996 said:
Thanks a bunch loopline, that did the trick. The new version of Scrapebox looks very nice by the way.

how did you manage to pull out the text from the <div>, I also try to use the page scanner but nothing works, I try to find a similar code that needs to be written, but there is no result either

calrnnn · Aug 21, 2021

loopline said:
I plan to make a video on it, in fact they are developing a general content scraper. Under grab/check >> custom data scraper. So I will do a video on it with that, its on the mental list.

you can help with the question above, no matter how I can not find the information what needs to be prescribed to get the result

loopline · Aug 21, 2021

calrnnn said:
you can help with the question above, no matter how I can not find the information what needs to be prescribed to get the result

Here is a video

M4DM4X · Aug 21, 2021

The paid plugin Article Scraper does it smoothly

How to scrape div content with Scrapebox?

dsan996

Regular Member

Repulsor

Senior Member

loopline

Elite Member

dsan996

Regular Member

loopline

Elite Member

Atomic76

Registered Member

loopline

Elite Member

calrnnn

Newbie

Attachments

calrnnn

Newbie

loopline

Elite Member

M4DM4X

Elite Member

Main Menu

Marketplace

Making Money

BlackHat World