What I'm working on now (what should i do with?)

dannyhw

Senior Member
Joined
Jul 16, 2008
Messages
979
Reaction score
476
I have a script that will look up the backlinks to a page and check each of them for nofollow. I think that's pretty decent on its own, for example for sites you know comment spammed.

My dilemma is it's too slow to turn into a web application. It's in PHP but it would timeout on the host. My other idea is to just bulk load urls into this thing locally and save to a database that I'll offer up for free. Maybe add the PR of the domain or something. I don't really know at this point.

I don't use windows and I'd hate to make a windows app...

Image not found: ftAee
 
Last edited:
How slow is it? You could change the php timeout var in php.ini. Here is some of what I have in my php.ini. I think the defaults are something like 30, 60, 8M.

max_execution_time = 9120 - increase for long run times
max_input_time = 9120 - increase for large uploads
memory_limit = 128M - increase if you have a memory hungry script

Another option is to just throw the script into your cron so you dont have to worry about php timeouts but that would be about the same as bulk loading.
 
Well I want to offer this as something free to people and I only have a crappy virtual hosting account. It's pretty slow. You figure 1,000 links from site explorer, then it has to check every one for the link and then find out if it's nofollow or not.

What I'll probably do is gather up a whole mess of URLs that I know are ranking because of spam and write a python script to run like 20 of these in parallel.
 
So far I at least got this list out of it:

http://danabbamont.wordpress.com/********-backlinks-guide/
 
It should be possible to open multiple connections. So maybe checking 20 sites at the same time.

How do you check the backlinks? Yahoo?

Greetings!
Sebastian
 
Yeah you can't do that in php. I need to learn some more python. I know at least enough to have a python script call 20 of the php script at the same time. I get by on a lot of that.
 
Back
Top