1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

What I'm working on now (what should i do with?)

Discussion in 'Black Hat SEO Tools' started by dannyhw, Dec 12, 2009.

  1. dannyhw

    dannyhw Senior Member

    Joined:
    Jul 16, 2008
    Messages:
    980
    Likes Received:
    462
    Occupation:
    Software Engineer
    Location:
    New York City Burbs
    I have a script that will look up the backlinks to a page and check each of them for nofollow. I think that's pretty decent on its own, for example for sites you know comment spammed.

    My dilemma is it's too slow to turn into a web application. It's in PHP but it would timeout on the host. My other idea is to just bulk load urls into this thing locally and save to a database that I'll offer up for free. Maybe add the PR of the domain or something. I don't really know at this point.

    I don't use windows and I'd hate to make a windows app...

    [​IMG]
     
    Last edited: Dec 12, 2009
  2. neoblah1984

    neoblah1984 Newbie

    Joined:
    Dec 8, 2008
    Messages:
    18
    Likes Received:
    3
    Occupation:
    Joyfully unemployed
    Location:
    A bomb shelter
    How slow is it? You could change the php timeout var in php.ini. Here is some of what I have in my php.ini. I think the defaults are something like 30, 60, 8M.

    max_execution_time = 9120 - increase for long run times
    max_input_time = 9120 - increase for large uploads
    memory_limit = 128M - increase if you have a memory hungry script

    Another option is to just throw the script into your cron so you dont have to worry about php timeouts but that would be about the same as bulk loading.
     
  3. dannyhw

    dannyhw Senior Member

    Joined:
    Jul 16, 2008
    Messages:
    980
    Likes Received:
    462
    Occupation:
    Software Engineer
    Location:
    New York City Burbs
    Well I want to offer this as something free to people and I only have a crappy virtual hosting account. It's pretty slow. You figure 1,000 links from site explorer, then it has to check every one for the link and then find out if it's nofollow or not.

    What I'll probably do is gather up a whole mess of URLs that I know are ranking because of spam and write a python script to run like 20 of these in parallel.
     
  4. dannyhw

    dannyhw Senior Member

    Joined:
    Jul 16, 2008
    Messages:
    980
    Likes Received:
    462
    Occupation:
    Software Engineer
    Location:
    New York City Burbs
  5. SebastianJu

    SebastianJu Power Member

    Joined:
    Mar 27, 2008
    Messages:
    679
    Likes Received:
    130
    It should be possible to open multiple connections. So maybe checking 20 sites at the same time.

    How do you check the backlinks? Yahoo?

    Greetings!
    Sebastian
     
  6. dannyhw

    dannyhw Senior Member

    Joined:
    Jul 16, 2008
    Messages:
    980
    Likes Received:
    462
    Occupation:
    Software Engineer
    Location:
    New York City Burbs
    Yeah you can't do that in php. I need to learn some more python. I know at least enough to have a python script call 20 of the php script at the same time. I get by on a lot of that.