1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Scrapebox Assistance

Discussion in 'Black Hat SEO' started by Ultraburner, Jan 2, 2011.

  1. Ultraburner

    Ultraburner Junior Member

    Joined:
    Jun 24, 2010
    Messages:
    123
    Likes Received:
    9
    Hey Guys,

    I'm trying to scrape a domain that I know has inner pages using the custom footprint site:xxxxxxx.com but SB isnt returning all the pages.

    Am I missing something?

    Cheers Si.
     
  2. bakxos

    bakxos Regular Member

    Joined:
    Aug 8, 2010
    Messages:
    498
    Likes Received:
    292
    Location:
    Scotland
    not all pages are indexed. Better to find a sitemap:)
     
  3. Ultraburner

    Ultraburner Junior Member

    Joined:
    Jun 24, 2010
    Messages:
    123
    Likes Received:
    9
    Thanks that will explain it.

    Is there anyway to scrape a site and grab everything?

    Si.
     
  4. carlito

    carlito BANNED BANNED

    Joined:
    Aug 22, 2010
    Messages:
    1,153
    Likes Received:
    326
    yes use the sitemap addon of SB
     
  5. yakamoz01

    yakamoz01 Newbie

    Joined:
    Sep 21, 2009
    Messages:
    12
    Likes Received:
    2
    i am trying a week but sites not affected
     
  6. Ultraburner

    Ultraburner Junior Member

    Joined:
    Jun 24, 2010
    Messages:
    123
    Likes Received:
    9
    Hey,

    I tried the XML Sitemap addon but the site I am trying to scrap doesnt have a sitemap. Why can't SB grab all the URLs?

    Any suggestions?

    Si.
     
  7. Jay SWAT

    Jay SWAT Newbie

    Joined:
    Oct 8, 2010
    Messages:
    9
    Likes Received:
    1
    Scrapebox is a very powerful tool but it is far from perfect.

    If there is no sitemap and the addons are not working for what you need then you may have to just log the urls manually.

    Your time might be better spent doing a fresh scrape instead of killing yourself trying to get this ONE site.
     
  8. fesente

    fesente Newbie

    Joined:
    Apr 8, 2009
    Messages:
    16
    Likes Received:
    0
    thanks