Scrape Box Gurus - Massive High PR Blog List But....

[cflanagan]

Guys,

First off let me say Scrapebox ROCKS! The more I use it the more things I can use it for. The best $50 you'll ever spend (I have 4 Licenses on 4 machines.. hehe)

Ok, so here's the problem. I am pretty much a scrape master, even before SB came along. Not that long ago I scraped a huge list of blogs, sorted them by category and by PR.

So now I have a list of these blogs (Root domain only). Now I want to know how I might scrape for comment boxes on a KNOWN list of URL's. This would be the equivalent of using the (Site: [Domain] Keyword) feature except on thousands of blogs at different domains.

For Example: In the "Technology" Topic I have
PR10 - 4 Sites
PR9 - 44 Sites
PR8 - 103 Sites
PR 7 - 360 Sites
PR5 - 1682 Sites
PR4 - 2508 Sites
PR 3 - 2050 Sites

Now before you go saying that's ez.. I ONLY have the root domain which is itself not necessarily a postable / commentable page. Ergo, I need to look for the blogfootprint within the site.. You dig? I.e. need to find a commentable page.

So rather than just using the keyword scraper to find the first 1000 blogs on the SE's (many of which will have low pr's of course) , I want it to find them from a KNOWN SET of domains.

Closest I've come to is setting up a custom Google search, (This will allow me to search ONLY a known set of domains) but it's not a perfect solution.

Any ideas?

 

[mark0v]

if I'm reading this correctly, I think you've almost answered your own question

take your list of domains in notepad and replace "http" with "site:http"
copy/paste that list into the keywords
start harvesting.
that should return up to 1000 pages for each of those blogs. you may want to break that into several groups so that the results are not too large.
take that list and run it through blog analyzer to find open comment forms etc. or check for PR on each of those pages, etc.

I think that there is also an addon which reads a sitemap or something from each blog, but I don't know how that works.

 

[thachcaodotcom]

Hi,
How can I get SB for $50 ? Is there a discount for BHW members? I found on their HP it is $97.
Thanks

 

[xinoanet]

Hi,
How can I get SB for $50 ? Is there a discount for BHW members? I found on their HP it is $97.
Thanks

Look for the official thread here at BHW

 

[Physaux]

I think scrapebox has a feature that you can scrape the sitemap of domains. You could use this on all your domains. Then you could run the blog analyzer, to try to filter pages that can be commented on. Export this list, and sort by PR of individual pages. Tada!

 

[turbopugsleylx]

Doesnt the Link extractor addon do this?


IE looking for internal links will show all the internal pages that he then can PR and blog check?

 

[Florist88]

I prefer to use the site: command as you then get the pages which G knows about as opposed to the ones that come off the Scrapebox Sitemap Scraper addon.
Like the above post mentioned, once you have that list, use the BlogAnalyzer addon to determine which ones you can comment on.

Split it all up into smaller lists though in case you need to restart due to proxies timing out or any other type of interference.