1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Need a search engine scraper

Discussion in 'Black Hat SEO Tools' started by billygood, Jun 4, 2011.

  1. billygood

    billygood Senior Member

    Joined:
    Sep 21, 2008
    Messages:
    941
    Likes Received:
    667
    Occupation:
    marketer
    Location:
    Florida in the winter
    Home Page:
    Hi everyone,

    I'm 100% Whitehat when it comes to my web sites and now I am working on a research project to help me understand some issues that I've encountered.

    the problem I've encountered is I've plateaued, nothing is working and some of the sites that I own are stuck on page 2 or 3. I would like to push them further. Since I stick to the hilltop algorithm for 99% of my SEOing I find that it's easy to make it 30th position, sometimes it's a breeze to get to rank 5, but I've encountered a huge boulder lately and I want to research a different angle of attack.

    the tool I need is a search engine scraper:
    I need to scrape the results of a keyword phrase from bing, yahoo and google . the first 500 to 1000

    I would like it to give me the results in an text file with the domain name and rank, I have no problem if it shows multiple results for the same domain.

    I would like it to work slowly, I don't want it to require the use of a proxy. I never hide when I do the SEO stuff and I'm rather happy with the success I have had. I would like something I could run overnight so that it does the job and the next morning I have 3 output files showing the results for yahoo, bing and google.

    does anyone have any ideas or point me in the right direction. I'm not in the mood to write my own macro script to try this out.

    thanks in advance
    Billy Good - Because I always bill them good
     
  2. bdtyrone

    bdtyrone Regular Member

    Joined:
    Nov 18, 2008
    Messages:
    216
    Likes Received:
    300
    Scrapebox?
     
  3. billygood

    billygood Senior Member

    Joined:
    Sep 21, 2008
    Messages:
    941
    Likes Received:
    667
    Occupation:
    marketer
    Location:
    Florida in the winter
    Home Page:
    What I have heard ( I don't know if it's factual )
    that it's blazing fast, and that would trigger problems with all the search engines, any other hint's or ideas ?
    BG
     
  4. bdtyrone

    bdtyrone Regular Member

    Joined:
    Nov 18, 2008
    Messages:
    216
    Likes Received:
    300
    You can always customize time delay and number of threads. Put thread number to one, use proxy then you'll be as good as a normal person finding his way through search engines. ;)
     
  5. scopezero

    scopezero Regular Member

    Joined:
    Mar 12, 2011
    Messages:
    336
    Likes Received:
    816
    Location:
    Bharat

    there is a scarper which is free but i dont recall the name , also u can use proxies with scarpebox which has also an inbuild proxy scarpingtool and then scarpe

    or if it is just for a single reserch purpose , pay 5$ to anyone here and they will do it for you

    i will post the name and link to that scarper after i have a look on my hard drive

    Regards
     
  6. billygood

    billygood Senior Member

    Joined:
    Sep 21, 2008
    Messages:
    941
    Likes Received:
    667
    Occupation:
    marketer
    Location:
    Florida in the winter
    Home Page:
    I want to thank everyone so far for there information. Scrape box seems to need proxies to work, and that's what I am avoiding, but any other ideas are more than welcome
     
  7. bdtyrone

    bdtyrone Regular Member

    Joined:
    Nov 18, 2008
    Messages:
    216
    Likes Received:
    300
    You can run scrapebox even without proxies.

    And there's the Thanks button hehe :)
     
    • Thanks Thanks x 1
  8. TwinDenis

    TwinDenis Newbie

    Joined:
    May 31, 2011
    Messages:
    11
    Likes Received:
    2
    I might need one to
     
  9. billygood

    billygood Senior Member

    Joined:
    Sep 21, 2008
    Messages:
    941
    Likes Received:
    667
    Occupation:
    marketer
    Location:
    Florida in the winter
    Home Page:
    went out and bought scrapebox, I'll know how well it works shortly tomorrow morning
     
  10. killacam

    killacam Newbie

    Joined:
    Apr 23, 2011
    Messages:
    28
    Likes Received:
    3
    best seo suite does what u say aka leaves the ranks etc