1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Need a web crawler 100 euro

Discussion in 'Hire a Freelancer' started by delite737, Nov 1, 2013.

  1. delite737

    delite737 Registered Member

    Joined:
    Nov 1, 2013
    Messages:
    70
    Likes Received:
    11
    Hi Everyone

    **EDIT*** it sounds like 100 wont cover this so if anyone wants to PM me a bid feel free to*

    this is a truly amazing forum,with some quality contributors,way out of my league I'm afraid

    I posted this in a few job places,but am only getting time wasters

    the script can be for a web crawler,example rapidminer or something,or if you have some online program you can store on my website whatever
    AND *IMPORTANT SHOW ME HOW TO APPLY IT FROM A BASIC USERS PERSPECTIVE

    I need a crawler that starts at multiple points A,B,C,D,E,F(has some predefinitions to ONLY crawl within certain URL address's)
    and has multiple end/destination points(A.B.C.D.E.F)

    I need this crawler to start at points a,b,c,d,e,f,and finish at points a,b,c,d,e,f either directly from the start page OR to show me a common denominator links to how it got there to the end point from the starting point,thats if theres a common denominator,

    example
    Man Utd(soccer team) Point A
    Chelsea(soccer team) Point B
    Starting at Uniteds results this year(predefined to stay only on the result links)
    it will find that it played chelsea a few weeks ago,so I would see the result of a direct connection

    If Man UTD Point A
    Team X Point B
    Man Utd have never played this team before,but CHELSEA HAVE PLAYED AGAINST TEAM X&CHELSEA HAVE PLAYED AGAINST MAN UTD
    The Crawler will crawl to Chelsea,then crawl to Team X
    and leave me know that the common denominator is chelsea

    It will need to put quickest destination first IF POSSIBLE(rather then going all over the place and eventually found it another route,yet route A was only two links away

    EVEN IF YOUR NOT INTERESTED CAN SOMEONE LEAVE ME KNOW IF THIS IS POSSIBLE?? I'm guessing it is and has been done but most of you before

    but thanks for the website and your contributions,if I could understand some of the content here I am sure I would be addicted!

    thanks for any help
     
    Last edited: Nov 1, 2013
  2. handmadebots

    handmadebots Senior Member

    Joined:
    Nov 8, 2012
    Messages:
    902
    Likes Received:
    204
    Home Page:
    It's possible, but I think it's too low for this one. Usually easy crawlers start from $50, but this one, from what I've understood it's not that easy.
     
    • Thanks Thanks x 1
  3. delite737

    delite737 Registered Member

    Joined:
    Nov 1, 2013
    Messages:
    70
    Likes Received:
    11
    thanks for the info,any ideas of prices,Id pay hire,although if its much higher Il still have to research prices before I come back here to hire someone
     
  4. handmadebots

    handmadebots Senior Member

    Joined:
    Nov 8, 2012
    Messages:
    902
    Likes Received:
    204
    Home Page:
    I will send you a PM.
     
  5. delite737

    delite737 Registered Member

    Joined:
    Nov 1, 2013
    Messages:
    70
    Likes Received:
    11
    thanks,cant send PM until I have around 15 posts,I was saying to on the post I still have an obligation to give my original guy another day or two to see if he produces the goods,I know he wont,I should be in touch in a day or two
     
  6. delite737

    delite737 Registered Member

    Joined:
    Nov 1, 2013
    Messages:
    70
    Likes Received:
    11
    it sounds like 100 wont cover this so if anyone wants to PM me a bid feel free to
     
  7. raalw1

    raalw1 Newbie

    Joined:
    Sep 16, 2013
    Messages:
    6
    Likes Received:
    1
    I can build it for you but we need to talk over specifics and the time frame... Let me know if your still interested and we can talk via skype : )
     
  8. delite737

    delite737 Registered Member

    Joined:
    Nov 1, 2013
    Messages:
    70
    Likes Received:
    11
    to poster above
    thanks PM me with your user account to a freelancer website or your own proven business and I will be happy to(because your even newer than me! ha,but I know the majority of viewers are lurkers rather than posters,so I wont disregard you because your a newb here)
     
    Last edited: Nov 1, 2013
  9. todordonev

    todordonev Regular Member

    Joined:
    Nov 23, 2012
    Messages:
    379
    Likes Received:
    228
    Gender:
    Male
    Location:
    Bulgaria
    Home Page:
    Sounds like ubot with some if-thens should do the trick although I cant really understand what you want.
     
    • Thanks Thanks x 1
  10. raalw1

    raalw1 Newbie

    Joined:
    Sep 16, 2013
    Messages:
    6
    Likes Received:
    1
    Ye I just browse through Blackhatworld, can't pm due to the 15 posts rule. I have no freelancer account anywhere or business set up as I work for myself and I build programs and crawlers as such and sell them. Saw your post and thought I'd do it with the little free time I have. As I said, we can talk over skype, if not then I hope you find what your looking for! :D
    Tc
     
  11. delite737

    delite737 Registered Member

    Joined:
    Nov 1, 2013
    Messages:
    70
    Likes Received:
    11
    Hi,
    I downloaded ubot as I have 30 day no question moneyback,just the standard version,it seems pretty hard to use,cant even find the if/then commands! watching some tutorials on youtube
     
  12. todordonev

    todordonev Regular Member

    Joined:
    Nov 23, 2012
    Messages:
    379
    Likes Received:
    228
    Gender:
    Male
    Location:
    Bulgaria
    Home Page:
    Did you buy Ubot or they have trail version? Nevermind play around a little bit with ubot dont focus on building what you need but on easy things like : register,login,if login pages exists then login,download to csv's,using lists tables etc etc. Just play with it and you will learn it in no time its relatively easy. Have fun.
     
  13. delite737

    delite737 Registered Member

    Joined:
    Nov 1, 2013
    Messages:
    70
    Likes Received:
    11
    Hi,yes bought ubot,got a 30 day money back guarantee,I dont think this can work for me because from what I can see,it is a web browser based bot that can only crawl on what the web page on the ubot browser is displaying,which would be far too slow,impossibly slow,and it also cannot do simultaneous crawling,it does have a tab feature,so each one can run individually

    I could of course be wrong on this but that is the impression I am getting from the first few tutorials
    any know if I am right on this?

    **BTW I want to reply to a few PM's but cant till I have 15 posts!!!
     
  14. riaak

    riaak Newbie

    Joined:
    Jan 30, 2009
    Messages:
    25
    Likes Received:
    13
    Occupation:
    student
    I sent you PM earlier. Waiting for reply to my email.
     
  15. Asif WILSON Khan

    Asif WILSON Khan Executive VIP Premium Member

    Joined:
    Nov 10, 2012
    Messages:
    10,115
    Likes Received:
    28,557
    Gender:
    Male
    Occupation:
    Fun Lovin' Criminal
    Location:
    London
    Home Page:
    • Thanks Thanks x 1
    Last edited: Nov 4, 2013
  16. riaak

    riaak Newbie

    Joined:
    Jan 30, 2009
    Messages:
    25
    Likes Received:
    13
    Occupation:
    student
    I'll do it for 100€, it doesn't really sound that hard if it is for one website only.
     
  17. delite737

    delite737 Registered Member

    Joined:
    Nov 1, 2013
    Messages:
    70
    Likes Received:
    11
    ***UPDATE
    I gave the job to sockpuppet
    I only asked him two days ago,I wasn't sure if he was serious because he didn't really ask me much questions
    He asked for higher than asking price(I didn't realize when posting offer,it was more complex than I thought)
    and the project was much harder than my example of a few football teams,this was data of enormously bigger combinations and possibilities,I was genuinely still going through any offers just incase,because I wasn't been asked much questions,for a complicated operation,but he came back within a day with a fully functional demo,

    **I HAVE RECEIVED THE SOFTWARE!!

    I give a solid recommendation of Sockpuppet

    Review of his work

    *Simply I havn't been just gobsmacked like that in all my life,this is the most amazing,perfect,it is honestly better than perfect
    It has extras,features and functionality of the data and the simple UI,but this is just shocking,it can do things I never asked for,lots of things I havn't thought of,

    broke data down by in so many ways,all calculated

    I mean I was using it half an hour before I discovered its full tricks and functionalities,its so simple and complex

    After I gave him the test url,the result was back within a minute,it is just insane,

    Also worth pointing out,to run it I just drag and drop a file on it and the ENTIRE process is taken care of,its totally magic

    I really cant believe my money could hire someone with work of this quality

    **Thanks anyone who asked for the job,and people who gave advice
     
    Last edited: Nov 10, 2013
  18. aoe316

    aoe316 Regular Member

    Joined:
    Sep 25, 2013
    Messages:
    254
    Likes Received:
    99
    OP from what I understand I think i have the program for you. I am going to post it in member downloads... and if whats you need why dont you throw me $20 if you can spare it.
    The program is call Teleport ultra.
     
  19. sockpuppet

    sockpuppet Junior Member

    Joined:
    Nov 7, 2011
    Messages:
    155
    Likes Received:
    145
    thx, it's a pleasure to work with you
     
  20. delite737

    delite737 Registered Member

    Joined:
    Nov 1, 2013
    Messages:
    70
    Likes Received:
    11
    UPDATE**

    received it!

    absolutely fantastic job,really is top class

    might write a proper review,but Im now going to bed

    thanks again sockpuppet