1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

How to control requests made by proxies in Scrapebox when scraping URLs and other tasks?

Discussion in 'Black Hat SEO' started by ninelives1980, Aug 21, 2013.

  1. ninelives1980

    ninelives1980 Newbie

    Joined:
    Aug 30, 2012
    Messages:
    16
    Likes Received:
    1
    The reason why I'm asking is because I think that cos of too many requests made in short span of time by my proxy, that I often get timeout errors when doing stuffs like ******** nofollow checker (the addon on Scrapebox).

    If what I assume here is correct - then how do I control amount of requests made by proxies (I assume this is measured in terms of url/s) when I'm doing stuffs like scraping URLs?

    Thanks!
     
  2. scrapefox

    scrapefox Power Member

    Joined:
    Dec 3, 2011
    Messages:
    692
    Likes Received:
    277
    When scraping: Settings -> Adjust Maximum Connections
    Using nofollow/******** checker: "connections"

    To be honest, when using addons like nofollow/******** test I don't even bother with proxies. If you're finding you get lots of timeouts you're probably running too many connections or the websites you're checking are actually down.
     
  3. jackkarter

    jackkarter Newbie

    Joined:
    Aug 21, 2013
    Messages:
    13
    Likes Received:
    7
    Occupation:
    Internet marketing
    Location:
    Ireland
    Home Page:

    Hi, I generally use about 30% connections to my proxies to stop them from getting suspended. That is, if I have 30 proxies, I use 10 connections.