1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Can Scrape 100s of Millions of URL with Scrapebox - No Rate - What to do with this Power?

Discussion in 'Black Hat SEO' started by TrailBlazer, Sep 23, 2015.

  1. TrailBlazer

    TrailBlazer Junior Member

    Joined:
    Aug 11, 2012
    Messages:
    170
    Likes Received:
    51
    I have a well connected friend who has given me access to over 10k+ private dedicated proxies to use for scrapebox. I am not allowed to use these proxies for absolutely anything else besides scraping google, which is fine with me since he's not charging me and I won't double cross him.

    That being said, I can scrape from scrapebox non-stop on however many threads I want to use without getting any rate. I can even use all the advanced operators like intittle: inurl: etc. etc. and still never get rated.

    The only thing i've been doing so far is using an email harvesting footprint to harvest millions of urls that I use scrapebox email grabber to extract the emails from. However, I want to hear if there are any other ideas of what I should be scraping from google that could be used for making some kind of profit. Either by selling the data, or using it myself.

    If you have any secret techniques or ideas you can PM me about a JV.

    I will also take requests of data I should scrape and release here for free on BHW, data that members here agree on that would help the community.

    I have all this power that i'm not utilizing to its full potential and I don't want it to go to waste. So let me know what ya think
     
  2. BreaknBrix

    BreaknBrix Power Member

    Joined:
    Mar 25, 2014
    Messages:
    757
    Likes Received:
    4,359
    Location:
    NE US
    I'd monetize that with PBNs or some sort of scraping service.

    Here are some ideas:

    1) Download the current Alexa Top 1 Million.
    2) Load those into Scrapebox and check them all for PR.
    3) Give the list away for free on BHW with the PR of each domain.

    Then people can sort by PR, run domains through Xenu and find expired domains.
    I don't know why but SB won't PR check for me. It always worked in the past but now it shits out almost immediately.

    You could also just get into scraping and selling expired domains. Although that involves a lot more than just SB.

    Or you could offer some type of custom scraping service.

    Just thinking outloud here...
     
    • Thanks Thanks x 1
  3. mainceaft

    mainceaft Regular Member

    Joined:
    Apr 10, 2013
    Messages:
    391
    Likes Received:
    40
    BreaknBrix Thanks for the link .the top million not even enough for non English sites . but it way to start
    BTW how much it take scrapping 1 million page using PHP script + LAMP VPS
     
  4. TrailBlazer

    TrailBlazer Junior Member

    Joined:
    Aug 11, 2012
    Messages:
    170
    Likes Received:
    51
    Pretty good suggestions, I've tried my luck with expired PBN hunting in the past, did fairly well, but ultimately I gave up on SEO. Hunting expired domains to sell would also be too time consuming for too little profit IMO.

    I was thinking of offering a custom scraping service, but i'm not sure there's a market for it unless I can find people who need more URLs than they can personally afford to buy proxies themselves to scrape with.

    No offense but make your own thread to ask off topic questions. I don't want this thread to get sidetracked with irrelevant questions that have nothing to do with my OP.
     
  5. LEADCODE

    LEADCODE Registered Member

    Joined:
    Aug 4, 2015
    Messages:
    66
    Likes Received:
    8
    A scraping service would work great considering the amount of proxies you have.

    Though you will need a couple of dedicated servers and a custom software if you want to automate everything.
     
  6. sashilover

    sashilover Junior Member

    Joined:
    Feb 4, 2015
    Messages:
    106
    Likes Received:
    12
    OP, are you interested in exchanging the resources, currently I scraped cnn/forbe/bbc etc. site for expired domains.
    and I have a list of 10K expired domains which has backlinks from top 100 sites, I want to share it with you.
    as a result, you help me scrape news lists with provided keywords.
    PM me if you are interested in that.
     
  7. TrailBlazer

    TrailBlazer Junior Member

    Joined:
    Aug 11, 2012
    Messages:
    170
    Likes Received:
    51
    Sorry I have no use for expired domains, i'd just give them all away here if I had that list, which i'm sure is something you wouldn't want. Thanks for the offer though.
     
  8. TrailBlazer

    TrailBlazer Junior Member

    Joined:
    Aug 11, 2012
    Messages:
    170
    Likes Received:
    51
    Anyone else have any ideas or want to JV with me on this?
     
  9. TrailBlazer

    TrailBlazer Junior Member

    Joined:
    Aug 11, 2012
    Messages:
    170
    Likes Received:
    51
    Last bump, anyone wana JV or have any ideas to use this power?