Recent content by jasperq

There's a project on github called "wayback-machine-downloader" which is an archive.org crawler done in Ruby. Allows you to specify date ranges (to pluck out certain versions of the site, e.g. before the domain-resellers grabbed the expired domain). Just need Ruby 1.9.2 installed, and gem does...

The mapping of IP addresses to domain names on a server is done through the webserver configuration. NginX's approach is quite straight-forward: Multiple server blocks, each block has a `listen` directive where you set the IP address, followed by a `server_name` directive that specifies the...

The process depends on who manages the DNS service that your domain name uses. The approach is to add an A record of your root domain to the IP address of the GoDaddy server that's hosting your site. And don't change the MX records or any of the TXT records to do with email verification (SPF and...

There's a ruby package called wayback_machine_downloader, so if you've got yourself a Linux box (VPS, VM or local machine), install that with ruby gems, and off you go. Neat thing is you can specify date ranges.

Just tried the PHP script in post #10, with a newly created account -- didn't work immediately. Waited 10 minutes and tried again and it works. Moz does say on creating a new API key that it takes about 20 minutes for this key to filter to all their servers. google.com/|100|96.46

Faking a user-agent is trivial, whether that's using a browser, or curl, or an HTTP library. It's just a piece of text. The bulk of the htaccess configurations mentioned in SEO circles use the User-Agent HTTP header as the string to match against to determine what the bot is. And then not check...

I'm getting decent results with wayback-machine-downloader. If you have a VPS (or a Linux box), install Ruby 2.3 and then run: gem install wayback_machine_downloader It accepts date ranges, concurrent request limits. It dumps the website to disk deleting out the wayback navigation guff. Grabs...

Have you used Facebook's open graph API before, or is this your first time? Also, are you using a Facebook SDK, or do you want to do it all yourself?

Fishkin answered a Quora question about the running cost of SEOMOZ linkscape. $700k per month since Aug 2012. It's running off Amazon's AWS, so lots of virtual machines, specialised for each part of their infrastructure. And using spot-instances (which essentially gives you cheap capacity when...

The public PR value is at least 6 months old, so an indicator to what G thought of the site 6 months ago PA and DA are based on someone trying to emulate G's algorithm (PA is supposed to map to the search rank order of a page). so PA and DA can be used as predictors to how G values a page or...

Great post, thank you Nick Flame. Be careful of leaving detectable footprints, this not only includes your own PBNs but other people's PBNs running in the same vicinity/neighbourhood/ipaddress Hosting for example, I know a couple of people are running their PBNs off hostnine, nominally off...