Scrapebox Assistance

U

Ultraburner

Junior Member

Jun 24, 2010

123

10

• Jan 2, 2011

• #1

Hey Guys,

I'm trying to scrape a domain that I know has inner pages using the custom footprint site:xxxxxxx.com but SB isnt returning all the pages.

Am I missing something?

Cheers Si.

 

bakxos

Regular Member

Aug 8, 2010

498

292

• Jan 2, 2011

• #2

not all pages are indexed. Better to find a sitemap

 

U

Ultraburner

Junior Member

Jun 24, 2010

123

10

• Jan 2, 2011
• Thread Starter Thread Starter

• #3

Thanks that will explain it.

Is there anyway to scrape a site and grab everything?

Si.

 

carlito

BANNED

Aug 22, 2010

1,152

328

• Jan 2, 2011

• #4

Ultraburner said:

Thanks that will explain it.

Is there anyway to scrape a site and grab everything?

Si.

Click to expand...

yes use the sitemap addon of SB

 

Y

yakamoz01

Newbie

Sep 21, 2009

12

2

• Jan 2, 2011

• #5

i am trying a week but sites not affected

 

U

Ultraburner

Junior Member

Jun 24, 2010

123

10

• Jan 2, 2011
• Thread Starter Thread Starter

• #6

Hey,

I tried the XML Sitemap addon but the site I am trying to scrap doesnt have a sitemap. Why can't SB grab all the URLs?

Any suggestions?

Si.

 

J

Jay SWAT

Newbie

Oct 8, 2010

11

1

• Jan 2, 2011

• #7

Scrapebox is a very powerful tool but it is far from perfect.

If there is no sitemap and the addons are not working for what you need then you may have to just log the urls manually.

Your time might be better spent doing a fresh scrape instead of killing yourself trying to get this ONE site.

 

F

fesente

Newbie

Apr 8, 2009

17

0

• Jan 2, 2011

• #8

thanks