1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

[Guide] Basics of Choosing Dedicated Server or VPS (ScrapeBox,XRumer, etc)

Discussion in 'White Hat SEO' started by madoctopus, Sep 12, 2011.

  1. madoctopus

    madoctopus Supreme Member

    Joined:
    Apr 4, 2010
    Messages:
    1,249
    Likes Received:
    3,498
    Occupation:
    Full time IM
    So, you need a dedicated server or a VPS and not sure which host to go with? I'm going to tell you a few important things you have to keep in mind.

    The reason I am writing this is because I've seen some threads with reviews for xsservers.eu and some are positive and some are negative and people wonder why. Most don't get it why some are positive and some are negative but I will explain.

    There are two things you have to pay attention to:

    1. Server specs - for a dedicated server this is the number and type of CPU(s), RAM, HDD, etc. Basically the hardware configuration. For a VPS it's the same plus the architecture the VPS runs on (Xen or OpenVZ).
    2. Network specs - server bandwidth, server network card type, host internet provider and network peering, etc.
    Firs of all, let's talk about server specs. Don't go for a more powerful server just like that. Server computing power comes from a balance of all it's hardware components. That means a web server with 16 cores but only 4GB RAM won't perform at it's best because of a RAM bottleneck. A web server with 2 cores and 16GB RAM will have a CPU bottleneck and the extra RAM won't help you much. You get the idea... a lot in an area (e.g. CPU) but little in another related area (e.g. RAM) will always produce a bottleneck. The perfect hardware setup is one that is perfect FOR YOUR SPECIFIC NEED. That means a server for scrapebox will have different requirements than an Apache web server and different than a database server and different than a server that is supposed to run a custom application of yours.

    Then, we have the network specs. I include network card and bandwidth and transfer speed here because these things have to do more with the throughput (throughput = real actual bandwidth that can be reached as opposed to the one on paper) than with the server computing performance.

    Generally speaking bandwidth is expensive but host companies have to provide it for cheap. That means they rely to marketing techniques to make you think you get a lot but also make sure you don't really use a lot. So what happens is, they will engineer the offer to have a massive bottleneck. They might offer you a 16 core server with 24GB of RAM but a 10mbps connection. Or if they give you 100mbps connection you have only 2TB bandwidth in a month and you pay if you go over that. All hosts that are cheap or seem affordable have a bottleneck like this. You might even have multiple bottlenecks - some at network level others at server hardware level. Explaining all the factors at play here is beyond the scope of this short guide though.

    A lot of you need servers for programs like ScrapeBox and XRumer. As opposed to a web or database server where a lot of RAM helps, in this case you don't need a lot of RAM. Also, I am not sure if ScrapeBox or Xrumer or whatever software you use makes use of multiple cores or not. Sine they are multithreaded they probably do, but I am not 100% sure. So to begin with, you don't need a lot of RAM. 2GB is plenty. Naturally if you plan to run lots of such programs at the same time you would think it's a good idea to have more RAM. NO! What happens is, you never reach a RAM bottleneck because you reach a network bottleneck much sooner.

    Which leads me to throughput. It is important to understand that the bandwidth the host offers and the speed they say they offer is A BIG FAT LIE. The speed is not a constant, it always depends on other factors including the Internet provider (carrier) of that host, peering (connectivity with other Internet providers/carriers) and also the computer you connect to. That means they might offer X terrabytes of bandwidth but they know you will never even consume half of that because it is impossible to do that on their network.

    To explain this better let's take xsservers.eu as an example. You make an account with them and you do a speed test for them. This is what happens:

    1. If you are located in Europe, you will see good speeds and eventually write a good review for them.
    2. If you are located in Europe and your ISP has peering with Frankfurt, Germany you get awesome speeds and eventually write a good review for them.
    3. If you are located in US, China, Japan, or anywhere else in the world, you get shitty 1-5Mbps speeds hence you write a bad review for them.
    So are they good or bad? The answer is simple, depends where you're scraping/blasting. Your location actually doesn't matter. For example if you're in USA you get shitty speeds with xsservers.eu or any host outside of USA for that matter, however if you use the server to scrape/blast mostly at sites hosted in Europe you get great speeds. The same way, if you're in Europe and the speed test is awesome, if you scrape/blast sites in USA or outside Europe, you will get shitty performance during the blasts. Obviously, most sites are hosted in USA though so I always prefer a server with great speed in USA instead of anywhere else in the world.

    The perfect setup would be to have 2 servers. One in USA and one in Europe. You would split your URL lists by region and have a list of URLs from Europe and another for the rest of the world. You blast one list from the European server and the other from your USA based server. This way you get optimal speeds.

    Back to server and network specs, a 100mbps dedicated bandwidth would give you 31TB monthly bandwidth. So, if you want the ultimate scraping/blasting machine go and buy a dedicated server with dedicated bandwidth and make sure you have enough CPU power to handle 70-100 requests/second so you top your bandwidth and not get bottlenecked at CPU level.

    The only way to get a good server that works well for you is to test it. There is no other way. That means you want to look for hosts that have a money back guarantee otherwise you have to be OK with the idea that you will just waste the price for a month so you test it.

    The reason the only way is to test the server comes down to the fact that there are multiple carriers and multiple peerings. That means while the host might say they give you unlimited shit and even dedicated bandwidth, there might be a peering bottleneck 2-3 routers away from their datacenter, the end result being lower speeds for you and all their servers for that matter.

    Hopefuly this will help you understand some key factors in finding a good server and host. Keep in mind that it is a very basic guide and I even "bent" facts a bit so it is easier for you to understand them.
     
    • Thanks Thanks x 13
  2. loopline

    loopline Jr. VIP Jr. VIP

    Joined:
    Jan 25, 2009
    Messages:
    3,384
    Likes Received:
    1,801
    Gender:
    Male
    Home Page:
    Thanks for the guide mate. You went into great detail. I assume someones follow up question will be where to host at, so here is what I use.

    I have used XSserver.eu, but for Xrumer, they aren't that great for scrapebox, too many crashes.

    I use Scrapebox VPS for my lighter scrapebox uses since its only a VPS.

    and I use Gigenet for my heavy scrapebox use - Dedi servers (the $280 special), although I have used many companies, the only other one to stay away from that I know of is FDC. Their config doesn't agree with scrapebox.
     
  3. madoctopus

    madoctopus Supreme Member

    Joined:
    Apr 4, 2010
    Messages:
    1,249
    Likes Received:
    3,498
    Occupation:
    Full time IM
    I personally don't use scrapebox or xrumer or other commercial tools but many here do so I thought I'd help with this aspect since I have seen questions about this asked a lot.

    I do have my own custom scraping/blasting programs and I always run them on 100mbps dedicated bandwidth because it is the most cost effective way.

    You can find many cheap dedicated servers, at one time I even found a special with a quad core, 4GB RAM for $49/mo but it obviously had low transfer speed.
     
    • Thanks Thanks x 1
  4. phatzilla

    phatzilla Supreme Member

    Joined:
    Apr 9, 2009
    Messages:
    1,366
    Likes Received:
    1,017
    thanks for the guide octopus.

    Could you recommend any dedicated servers that allow you to use "blackhat" programs and have good specs / dedicated bandwidth?
     
  5. virtualc08

    virtualc08 Supreme Member

    Joined:
    Mar 23, 2010
    Messages:
    1,380
    Likes Received:
    951
    Wow this is great.. This thread should be stickied ! This will definitely help a lot of noobs and also a lot of pros.

    Thanks madoctopus!
     
  6. seoguy99

    seoguy99 Jr. VIP Jr. VIP

    Joined:
    Nov 6, 2010
    Messages:
    2,305
    Likes Received:
    513
    Occupation:
    SEO
    Home Page:
    thats great.needed it really.
    between many of the vps companies provide with russian ip [for xrumer uses], you meant its not a goood thing...hmmmm
     
  7. madoctopus

    madoctopus Supreme Member

    Joined:
    Apr 4, 2010
    Messages:
    1,249
    Likes Received:
    3,498
    Occupation:
    Full time IM
    There's the one I use but I never tell others about the specific resources or services I use if there's even a remote chance it will affect me in the future. It's a rule of mine and so far it has proved to be a good rule. These guys are not really happy with users doing blackhat stuff but they don't bug me because they never get complaints because of me.

    Basically if you want a very good server you need to look at something that had decent hardware but also 10TB or more bandwidth or a DEDICATED 50mbps or higher bandwidth. iweb.com kinda fits these principles but I have never personally used them. They're also very affordable considering what they offer.
     
  8. hunter75

    hunter75 BANNED BANNED

    Joined:
    Jul 15, 2015
    Messages:
    39
    Likes Received:
    11
    I don't know what this is but it looks dead cheap. will it run scrapebox? Please do reply.
    Check the specs which i copied form their website.
    OpenVZ 2048mb (Buffalo, NY) Buffalo, New York (US) - OVZ2048 2GB Dedicated Ram | 2GB vSwap | 150GB HDD | 4TB Bandwidth | 1 IP | 1 Gbps Link Speed
     
  9. THUNDERELVI

    THUNDERELVI Elite Member

    Joined:
    Sep 12, 2009
    Messages:
    2,203
    Likes Received:
    1,732
    Gender:
    Male
    Location:
    W3
    You just bumped a 4-year old thread, good job!
     
  10. V

    V Elite Member

    Joined:
    May 18, 2012
    Messages:
    2,113
    Likes Received:
    2,543
    Occupation:
    Student
    Location:
    /tmp
    Very good guide to choose dedicated servers and VPS for our needs. A lot of people will find it useful because not everyone knows about these things in the beginning of their IM career.
     
  11. startagraphic

    startagraphic Junior Member

    Joined:
    Jul 13, 2015
    Messages:
    101
    Likes Received:
    1
    Very helpful and clear information for people. Thanks for the guide mate.
     
  12. agentk007

    agentk007 Junior Member

    Joined:
    Aug 16, 2008
    Messages:
    132
    Likes Received:
    32
    Occupation:
    Internet Marketing & SEO Services
    Location:
    Hoi An, Vietnam
    Home Page:
    So I understand this is an ancient post but still very relevant. In fact, I learned a LOT just reading through it a couple days ago.
    I just got myself a VPS that I believe is bottlenecked with RAM. Would love your feedback.
    It's got 5 processors (3.2 Ghz) but only 3 GB of RAM. The connection is mid to high 500 Mbps (up and download) with a 1 Gbps port. It's pretty obvious that RAM would be the bottleneck (I think) but even when running 4 instances of ScrapeBox at 50+ threads each, I never see the RAM used go above 1000 MB.
    Up until now I figured the machine was just that great or that the extra processors eliminated the need for lots of RAM, but now I'm wondering if I'm reading it wrong.
    See screenshot:
    Screenshot.jpg
    Just because it has 3 GB of RAM does not mean I get to use 3 GB (or 2 GB) for that matter. Or am I reading this wrong?