1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Can i use scrapebox as a "cache warmer"?

Discussion in 'Black Hat SEO Tools' started by flannn, Jan 8, 2014.

  1. flannn

    flannn Newbie

    Joined:
    Jul 20, 2008
    Messages:
    31
    Likes Received:
    3
    If so, what is the best road to walk? I assume ping aint working (ping wont load the pages, right? will the link checker work or do i need to use a addon to get better/faster results?)
    Maybe there is a better way to "warm" my caches but i think scrapebox can be used for it.

    extra info: i need to warm my caches for "magento" (don't laugh :p)
     
  2. tahworld

    tahworld Regular Member

    Joined:
    Aug 16, 2013
    Messages:
    457
    Likes Received:
    393
    Location:
    ✔✔✔✔✔✔✔
    I think the link-checker only received http headers.
    Try the link extractor several times. I reads the pages.
     
  3. flannn

    flannn Newbie

    Joined:
    Jul 20, 2008
    Messages:
    31
    Likes Received:
    3
    link checker seems to do the job. Images and all stuff seems to be cached and loading. I'm using the standard checker... tested with the link checker addon, but i don't like that one.

    Thanks! My customers will love the fresh cached pages ;-)
     
  4. tahworld

    tahworld Regular Member

    Joined:
    Aug 16, 2013
    Messages:
    457
    Likes Received:
    393
    Location:
    ✔✔✔✔✔✔✔
    :)
    ___________________________________
     
  5. thedorf

    thedorf Senior Member

    Joined:
    Oct 1, 2008
    Messages:
    1,193
    Likes Received:
    700
    Occupation:
    what? I gotta have a job?
    Location:
    BHW - Where else?
    Another way to do this is to make a cron job that runs every 5 minutes (or so) using "get" to call the pages. I do this across websites but I see no reason not to do it on the same domain the website resides on. Mine (on Hostgator and cPanel) looks like this:

    Code:
    /usr/bin/GET http://YourDomain.com/ >/dev/null 2>&1
     
  6. flannn

    flannn Newbie

    Joined:
    Jul 20, 2008
    Messages:
    31
    Likes Received:
    3
    Thanks for the suggestion, but this way i need to add 1 cron per url. Not a real time safer if i need to crawl thousands of urls. And the time when the urls need to be crawled are daily but not on the same time, so i need to edit the cron times every day.

    I'll use scrapebox with the default link checker until i see problems in my cached pages or when someone got a better solution.

    LOL.... i'm thinking.... and that's when troubles will start ;-) BUT is there a way to let visitors cache pages in the background when they visit a cached page? Maybe "hole-punche" (if that is needed) a sneaky iframe to load 1 url from a list that needs to be cached? I think google won't like it, but that aint my problem but if anti-virus tools will flag my website it IS a problem.
     
    Last edited: Jan 8, 2014
  7. zyx2000

    zyx2000 Registered Member

    Joined:
    May 6, 2011
    Messages:
    54
    Likes Received:
    5
    I think you could use Xenu's Link Sleuth for this. It's a free program.