1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

I can't set up number of results in scrapebox

Discussion in 'Black Hat SEO' started by Drago05, Jan 14, 2011.

  1. Drago05

    Drago05 Junior Member

    Joined:
    Oct 31, 2010
    Messages:
    151
    Likes Received:
    10
    Location:
    Europe
    I can't set up harvester to scrape more than 1000 url's. Whatever number i put in the box it changes back to 1000. I can put only numbers under 1000 but above 1000 it changes back to 1000.
     
  2. uditbhansali

    uditbhansali Regular Member

    Joined:
    Aug 16, 2010
    Messages:
    486
    Likes Received:
    283
    Occupation:
    Ask your mom
    You can only scrape 1000 urls from each search engine and for each keyword. It's the maximum limit.
     
  3. Drago05

    Drago05 Junior Member

    Joined:
    Oct 31, 2010
    Messages:
    151
    Likes Received:
    10
    Location:
    Europe
    I don't understand. If i want to scrape 200.000 url's, i have to have 200 keywords. How can i get targeted results then? I don't want to use variations for my keywords.
     
  4. Drago05

    Drago05 Junior Member

    Joined:
    Oct 31, 2010
    Messages:
    151
    Likes Received:
    10
    Location:
    Europe
    Why this program is limited to 1000 url's per keyword? If i search google, for example, "make money online" it gives 15,000,000 results but with scrapebox i couldn't scrape even 1000 results. It finds about 800 url's. How to scrape more url's for this keyword? I need at least 400.000.
     
  5. loopline

    loopline Jr. VIP Jr. VIP

    Joined:
    Jan 25, 2009
    Messages:
    3,382
    Likes Received:
    1,801
    Gender:
    Male
    Home Page:
    Its the engines, such as Google, that set the 1000 limit. Scrapebox uses the API to pull results from google and the other engines, the engines limit the max results to 1000. The alternative is for your to hand copy and paste all the millions of urls which isn't practical. Thus we are stuck with what the engines limit us too.

    Basically the engines don't want to pay for the servers and data centers just so you can extract millions of urls so you can use them to then turn around and manipulate the search results, just so the engines can pay someone to try and keep you from doing that.

    Its simply, they exist to make money, you want to cost them money, they don't like that.
     
    • Thanks Thanks x 1
  6. Drago05

    Drago05 Junior Member

    Joined:
    Oct 31, 2010
    Messages:
    151
    Likes Received:
    10
    Location:
    Europe
    Thanks!

    I have read that to find relevant blogs to comment on, it is good to use "allintitle". So, if i search, for example, "allintitle:xbox games", i am limited only to 1000 blogs.

    Is there some other way to collect more url's, with macros or something else? I need a lot more than 1000 url's.
     
  7. crazyflx

    crazyflx Elite Member

    Joined:
    Nov 9, 2009
    Messages:
    1,674
    Likes Received:
    4,825
    Location:
    http://CRAZYFLX.COM
    Home Page:
    Google, Bing & Yahoo (and every other search engine) won't allow you to view more than 1,000 results, whether it be done manually or with an automated software.

    If you search google for a phrase with more than 1,000 results, and went to page 100 of the search results, you'd have to stop there. Google won't show the "next" button anymore...neither will any other search engine.

    While many think that SB uses an API to scrape google, it doesn't. It actually visits all 10 results pages (if there are 10) with the settings on 100 results per page. Neither you or any software will ever be able to view more than 1000 results for any given search term.

    Here is a link to a google search. I have the settings on 100 results per page, and the link will take you to page 10 (so all 1000 results). You'll notice there is no next button, even though there are eight hundred million results: http://www.google.com/search?q=dogs...3QxTb3CHs_3gAe24OWTCw&start=900&sa=N&filter=0

    The only way to gather more related URLs is to use more keywords and variations of your keywords. If your keyword phrase is:

    Train Dogs

    You'll need to use TONS of other related phrases like:

    train dogs
    train dogs at home
    train dogs to jump
    train dogs to bark
    train dogs like german shepherds
    etc
    etc
    etc
     
    • Thanks Thanks x 2
    Last edited: Jan 15, 2011
  8. safex

    safex Jr. VIP Jr. VIP

    Joined:
    Dec 28, 2009
    Messages:
    3,433
    Likes Received:
    518
    Occupation:
    Search Engine Optimization
    Location:
    BLCVA.com
    Home Page:
    well, sometimes the keyword you will be targetting may only have 700 blogs in wordpress only. So It is the maximum limit which they are pulling. still there are too many option like footprint etc which you can use for getting more blogs with same keyword.