Scrapebox - What am I doing Wrong Here?

N

nam6641

Supreme Member

Nov 15, 2008

1,470

926

• Nov 16, 2010

• #1

I want to harvest all the blog posts at a blog so I'm using this in scrapebox

Code:

inurl:http://sade2009.com/blog

I'm also using Google results, and I'm selecting 'custom footprint'. Yet Scrapebox is returning zero results for me. If I go to Google.com and type that same search query in I see 5,000 results. Am I making a dumb mistake in scrapebox or...?

 

bakxos

Regular Member

Aug 8, 2010

498

292

• Nov 16, 2010

• #2

use this instead

Code:

site:sade2009.com/blog

it seems to work. Also check your proxies

 

kensai

Junior Member

May 5, 2010

100

42

• Nov 16, 2010

• #3

lose the http:// part

 

N

nam6641

Supreme Member

Nov 15, 2008

1,470

926

• Nov 16, 2010
• Thread Starter Thread Starter

• #4

How many results do you get? I tried using the site: and I got 10 results in Scrapebox but I show over 1000 when i go to google.com myself

 

N

nam6641

Supreme Member

Nov 15, 2008

1,470

926

• Nov 16, 2010
• Thread Starter Thread Starter

• #5

kensai said:

lose the http:// part

Click to expand...

i tried that, still getting nothing with inurl: and still getting 10 with site:

how many are you able to harvest? by the way, it is an auto approve blog

 

bakxos

Regular Member

Aug 8, 2010

498

292

• Nov 16, 2010

• #6

use this site:sade2009.com/blog and you will get around 700 urls. Import them as keywords and repeat and you will more. Remove duplicate urls and problem solved

The blog seems to have some kind of problem atm (it seems down ). If its wp use

Code:

site:sade2009.com/blog "leave a"

to get more posts (you cannot comment on tags url for example)
if its blogengine use:

Code:

site:sade2009.com/blog  "Notify me when new comments are added"

 

N

nam6641

Supreme Member

Nov 15, 2008

1,470

926

• Nov 16, 2010
• Thread Starter Thread Starter

• #7

Thanks, I'll give that a shot. I'm just curious why it won't scrape the 5,000 URLs that match inurl:sade2009.com/blog

missing out on a lot of backlinks and this is just one site.

 

bakxos

Regular Member

Aug 8, 2010

498

292

• Nov 16, 2010

• #8

Search engines give the first 1000 results. You need more keywords for more results. Try what i told you and see if it works.

 

s4nt0s

Elite Member

Jr. VIP

Jul 10, 2009

6,319

2,643

• Nov 16, 2010

• #9

nam6641 said:

I want to harvest all the blog posts at a blog so I'm using this in scrapebox

Code:

inurl:http://sade2009.com/blog

I'm also using Google results, and I'm selecting 'custom footprint'. Yet Scrapebox is returning zero results for me. If I go to Google.com and type that same search query in I see 5,000 results. Am I making a dumb mistake in scrapebox or...?

Click to expand...

Using the "site:" operator it worked fine for me and pulled up around 492 URL's. I ran a PR check on the URL's and all of them are PR0 or N/A ... definitely not the best pages in the world to comment on.

If you want the list, just let me know and I'll send over to you.

 

N

nam6641

Supreme Member

Nov 15, 2008

1,470

926

• Nov 16, 2010
• Thread Starter Thread Starter

• #10

i'm only getting 60 results using the following

Code:

site:sade2009.com/blog/ "a"
site:sade2009.com/blog/ "the"

it's gotta be a scrapebox issue on my end.

 

s4nt0s

Elite Member

Jr. VIP

Jul 10, 2009

6,319

2,643

• Nov 16, 2010

• #11

Do your settings look like this?

 

T

TwistedMarketing

BANNED

Apr 18, 2008

279

113

• Nov 16, 2010

• #12

972 urls from me

 

Attachments

• sade.rar

  4.4 KB · Views: 3

N

nam6641

Supreme Member

Nov 15, 2008

1,470

926

• Nov 16, 2010
• Thread Starter Thread Starter

• #13

Yes, my settings look like that. Weird that mine craps out. I have two SB licenses, one on my personal computer and one on a dedicated server and neither works well for this query.

Ha, nice job with the 927.

 

N

ngans

Newbie

Apr 12, 2010

2

1

• Nov 16, 2010

• #14

To my experience the scrape volume differs over proxy quality. I won't risk my private proxies on harvesting. So what I do is to move the top dozen of proxies to bottom of the list (usually I have tens of harvested proxies for harvesting). Usually the scrape results increase significantly.

 

simpleonlinetest

Regular Member

Feb 18, 2010

208

25

• Nov 16, 2010

• #15

Have you tried using the addon > link extractor to pull all the internal pages off that blog?

That might pull every post on the site.

 

D

dangervol

Registered Member

Aug 10, 2009

73

38

• Nov 16, 2010

• #16

I checked it twice and got zero hits. Then I checked my proxies and all were bad - I hadn't updated. I then used private proxies and got 844 urls. I think it must be a proxy issue with you.

I just put site:sade2009.com/blog/ in as the custom footprint and not in as a keyword and got the 844.

DV

 

beaglejuice

Power Member

Mar 12, 2009

744

487

• Nov 16, 2010

• #17

Google will show 5k because it also indexed tags and comments, etc. Try scraping

Code:

 [URL]http://sade2009.com/blog/sitemap.xml[/URL]

using sitemap scraper and you'll see 5k+ results.

nam6641 said:

I want to harvest all the blog posts at a blog so I'm using this in scrapebox

Code:

inurl:http://sade2009.com/blog

I'm also using Google results, and I'm selecting 'custom footprint'. Yet Scrapebox is returning zero results for me. If I go to Google.com and type that same search query in I see 5,000 results. Am I making a dumb mistake in scrapebox or...?

Click to expand...

 

mathdoc

Junior Member

Feb 28, 2010

142

12

• Nov 16, 2010

• #18

It's an issue with your proxies mate.