1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

[WTH] Freelancer to Program a Bulk DMOZ Listing Checker

Discussion in 'Hire a Freelancer' started by crazyflx, Jun 24, 2011.

  1. crazyflx

    crazyflx Elite Member

    Joined:
    Nov 9, 2009
    Messages:
    1,674
    Likes Received:
    4,825
    Location:
    http://CRAZYFLX.COM
    Home Page:
    DON'T PM ME ABOUT THIS. JUST POST YOUR BID HERE AND I'LL PM YOU IF SELECTED. OR YOU CAN SIMPLY BID AT EITHER OF THE FREELANCER SITES BELOW.

    If you're more comfortable working from a site like scriptlance or freelancer.com, I have this project posted on both sites. Here are the project URLs:

    http://www.scriptlance.com/projects/1308946422.shtml
    https://www.freelancer.com/projects/Visual-Basic-NET/Bulk-DMOZ-Listing-Checker.html

    And here is the job description:

    My OS is Windows 7 64-bit, however I would like this software to work on Windows 7, Windows Vista & Windows XP if possible.

    I need a simple software that checks a list of URLs for listing in the dmoz.org's index.

    Here is how you check to see if a website is listed in the dmoz.org index.

    You navigate to this URL:

    http://www.dmoz.org/search?q={insert domain name here}

    Example of a domain that IS listed in the dmoz.org index:

    http://www.dmoz.org/search?q=dnsboss.com
    For the above URL that is listed, when you arrive at that URL, you'll notice if you view the source code, that dnsboss.com is inside of an href attribute...in other words, there is a live clickable link on that page that leads to dnsboss.com. The live link appears as http://www.dnsboss.com even though the URL you've visited to check doesn't have the "www" in front of dnsboss.com. Some will have the "www" and some won't have the "www" in the live link.

    Example of a domain that is NOT listed in the dmoz.org index:

    http://www.dmoz.org/search?q=thisweekendsmovies.com
    You'll notice that when you arrive at that URL, nothing is present.



    The software should two input boxes with vertical scroll boxes in the UI.

    One should be for proxies, and the other should be for inputting a list of URLs.

    The box with the proxies should accept proxies in this format:

    ip address:port
    ip address:port
    ip address:port
    etc
    etc
    etc


    The box with the list of URLs should accept URLs in this format
    somesite.com
    somesite.org
    somesite.net
    etc
    etc
    etc

    The software should then begin checking if each URL in the input list is present in the dmoz.org index using the method indicated above. It should use a new proxy for each URL it is checking, going through the whole list of proxies. Once it reaches the last proxy in the list, it should then start over at the top of the list of proxies, and continue in that fashion

    The last box in the UI should be the "results" box, which should list the results of whether or not the URL is present in the dmoz index. It should list the results in this format (vertically):

    Input URL | Listed in Dmoz
    someurl.com | Y
    anotherurl.com | N
    etc
    etc
    etc
     
  2. wkrappen91

    wkrappen91 Power Member

    Joined:
    Sep 9, 2010
    Messages:
    588
    Likes Received:
    720
    Location:
    127.0.0.1
    Would you be fine with PHP, or do you want it desktop based?
    Also, how quick does dmoz ban an IP? Is there really a need for proxies?
     
  3. mars1

    mars1 Registered Member

    Joined:
    May 5, 2009
    Messages:
    88
    Likes Received:
    8
    Hello,

    I can develop a bot for you and it can complete the tasks you need.
    You can see some of my works here:
    Code:
    http://madallas.com
     
  4. crazyflx

    crazyflx Elite Member

    Joined:
    Nov 9, 2009
    Messages:
    1,674
    Likes Received:
    4,825
    Location:
    http://CRAZYFLX.COM
    Home Page:
    Ideally, I was looking for a desktop application. Also, yes, proxies are 100% a requirement, as I'm doing mass checks (xxx to xxxx in the number of URLs I'm checking).

    I have uBot, and have already made a uBot that performs the task I've outlined, but it is just so slow as it isn't mult-threaded. That's why I was looking for an actual programmer to make this in an actual programming language.
     
  5. BugFixed

    BugFixed Junior Member

    Joined:
    Sep 24, 2010
    Messages:
    130
    Likes Received:
    39
    I can provide 32-bit application, but i should work with 64-bit (Win7 64-bit) environment.
     
  6. risefromdeath

    risefromdeath Power Member

    Joined:
    Jul 1, 2009
    Messages:
    650
    Likes Received:
    107
    Incase you decide to go with PHP here is my offer
    $125/2 days
    PHP based
     
  7. zelma143

    zelma143 Power Member

    Joined:
    Jun 25, 2010
    Messages:
    571
    Likes Received:
    37
    Occupation:
    PHP programmer,Bot maker,iMacro script maker
    How about PHP??

    80$-> PhP is not support multithreads but it will rock. it's damn faster then UI. also it's support proxy as well..

    let me know

    thx
     
  8. risefromdeath

    risefromdeath Power Member

    Joined:
    Jul 1, 2009
    Messages:
    650
    Likes Received:
    107
    Read about curl_multi_x :)
     
    • Thanks Thanks x 1
  9. zelma143

    zelma143 Power Member

    Joined:
    Jun 25, 2010
    Messages:
    571
    Likes Received:
    37
    Occupation:
    PHP programmer,Bot maker,iMacro script maker
    oh got it..

    thx mate. :)

     
  10. Subsonic

    Subsonic Regular Member

    Joined:
    Mar 17, 2011
    Messages:
    367
    Likes Received:
    333
    Location:
    DNS root zone database
    I will do it for 150$ and it will take approximately two days. You can see my experience in bot development from the following threads:

    http://www.blackhatworld.com/blackh...ation-tool-ultimate-domain-name-research.html
    http://www.blackhatworld.com/blackh...eded-new-search-engine-optimization-tool.html

    I develop with Visual Studio 2010 so you'll need .Net Framework 4.0 to run the program (it's free and it works under 64bit Windows 7). The program will be multi-threaded and support proxies + it's desktop based. Based on my earlier development efforts, the software will check anywhere from 100 to 700 sites per minute (depending on the DMOZ server's load).

    Pm me if interested, thx! If you are not happy with the price, I'm always open for suggestions.
     
    Last edited: Jun 25, 2011
  11. wkrappen91

    wkrappen91 Power Member

    Joined:
    Sep 9, 2010
    Messages:
    588
    Likes Received:
    720
    Location:
    127.0.0.1
    Ill do it for 100 with rolling-curl-multithreading.
     
  12. crazyflx

    crazyflx Elite Member

    Joined:
    Nov 9, 2009
    Messages:
    1,674
    Likes Received:
    4,825
    Location:
    http://CRAZYFLX.COM
    Home Page:
    Sorry, I wasn't around most of this weekend, but I actually found somebody to take care of this (they actually already have).

    Thanks for everybody's offers though, I appreciate it.