Recent content by rodyaj

I want to make a simple proxy checker in e.g., Perl. It doesn't have to be too flashy, but it will need to check a lot of proxies and at least tell me their speed and if they are anonymous or not. At the moment I check 1000s of proxies in Charon, but I want something that integrates better with...

What ISP are you on? I live in the UK.

Are there any Linux VPS or shell providers that turn a blind-eye to port scanning? I'm sure most of them need to include that they are against it in their TOS to cover themselves, but is anyone here actively using such accounts for port scans over a long period of time without getting a...

Thanks for the detailed info. For the time being if I find a good enough domain I'm just going to register it as I'm looking for a quick flip anyway.

Well actually, Canada domains are the ones I'm looking to purchase.

On a 100mbit VPS what is the max connections I should set for URL harvesting on scraped public proxies? They seem to burn out within about 10 minutes if I go much above 100 in the max connections. Should I just try to add as many proxies as I have connections, or will I really need to lower the...

I'm just doing the same as most other people: scraping SERP results. Right now I'm using the one crazyflx posted on these forums (search "get Google suggest scraper huge lists"). I also have a bash script which scrapes Google, Amazon, Bing, Blekko and a few other sources (but I don't use it just...

Good idea. At some point I will make a blacklist of sorts and then post it here. For now, though, I'm going to concentrate on trying to build up a more long-tail keyword list for merging. In theory, I should be able to get to those outer fringes you speak of by doing this. I'm going to try and...

That makes sense nipester. It does seem as though the same big authority sites keep coming up simply because of the sheer volume of keywords they rank for. I guess the only way to try and avoid it is by trying to generate keyword lists with more niche and longtail words, but this is actually...

What is the secret to getting a low number of dupe results from Scrapebox harvests? When I scrape for URLs I'm getting 60+% dupes (often more), which means wasted time and burned proxies. I've tried using bigger keyword lists and setting pages to scrape down from 1000 to 100, but I'm still...

I need to register some domains not in my country. Will it be enough to just use a proxy or will I need to setup a VCC for purchase as well? Do I risk having the domain taken away from me, or will they never know the difference?

Nice software. It is indeed very simple to use, and multi-threaded as well. I like how you can see individually which keywords scrape the most urls. Also like being able to test the proxies against a specific url. In future versions I'd like to see PR checker and ability to scrape more than 10...

Could you re-upload the version with bugfix for proxy support please? Mediafire link is down.

Google probably does do a few basic checks e.g., whether timezone matches up and whether IP is from a VPN, but imo this is only the initial phase to help them cut the list down. Even if you get past this bit, you still have the manual review to get past. I think the reviewers have been told to...

There are some free alternatives you can use until Scrapebox comes back up: Scraper and PR checker: search forums for "get free search engine scraper v0-4-a" (thx christoss1959) Other scraper: sickscraper made by sicksubmitter guys, but it is a little buggy for me Other scraper...