Need a web crawler 100 euro

Hi Everyone

**EDIT*** it sounds like 100 wont cover this so if anyone wants to PM me a bid feel free to*

this is a truly amazing forum,with some quality contributors,way out of my league I'm afraid

I posted this in a few job places,but am only getting time wasters

the script can be for a web crawler,example rapidminer or something,or if you have some online program you can store on my website whatever
AND *IMPORTANT SHOW ME HOW TO APPLY IT FROM A BASIC USERS PERSPECTIVE

I need a crawler that starts at multiple points A,B,C,D,E,F(has some predefinitions to ONLY crawl within certain URL address's)
and has multiple end/destination points(A.B.C.D.E.F)

I need this crawler to start at points a,b,c,d,e,f,and finish at points a,b,c,d,e,f either directly from the start page OR to show me a common denominator links to how it got there to the end point from the starting point,thats if theres a common denominator,

example
Man Utd(soccer team) Point A
Chelsea(soccer team) Point B
Starting at Uniteds results this year(predefined to stay only on the result links)
it will find that it played chelsea a few weeks ago,so I would see the result of a direct connection

If Man UTD Point A
Team X Point B
Man Utd have never played this team before,but CHELSEA HAVE PLAYED AGAINST TEAM X&CHELSEA HAVE PLAYED AGAINST MAN UTD
The Crawler will crawl to Chelsea,then crawl to Team X
and leave me know that the common denominator is chelsea

It will need to put quickest destination first IF POSSIBLE(rather then going all over the place and eventually found it another route,yet route A was only two links away

EVEN IF YOUR NOT INTERESTED CAN SOMEONE LEAVE ME KNOW IF THIS IS POSSIBLE?? I'm guessing it is and has been done but most of you before

but thanks for the website and your contributions,if I could understand some of the content here I am sure I would be addicted!

thanks for any help

It's possible, but I think it's too low for this one. Usually easy crawlers start from $50, but this one, from what I've understood it's not that easy.

thanks for the info,any ideas of prices,Id pay hire,although if its much higher Il still have to research prices before I come back here to hire someone

I will send you a PM.

handmadebots said:

I will send you a PM.

Click to expand...

thanks,cant send PM until I have around 15 posts,I was saying to on the post I still have an obligation to give my original guy another day or two to see if he produces the goods,I know he wont,I should be in touch in a day or two

it sounds like 100 wont cover this so if anyone wants to PM me a bid feel free to

I can build it for you but we need to talk over specifics and the time frame... Let me know if your still interested and we can talk via skype : )

to poster above
thanks PM me with your user account to a freelancer website or your own proven business and I will be happy to(because your even newer than me! ha,but I know the majority of viewers are lurkers rather than posters,so I wont disregard you because your a newb here)

Sounds like ubot with some if-thens should do the trick although I cant really understand what you want.

Ye I just browse through Blackhatworld, can't pm due to the 15 posts rule. I have no freelancer account anywhere or business set up as I work for myself and I build programs and crawlers as such and sell them. Saw your post and thought I'd do it with the little free time I have. As I said, we can talk over skype, if not then I hope you find what your looking for!
Tc

todordonev said:

Sounds like ubot with some if-thens should do the trick although I cant really understand what you want.

Click to expand...

Hi,
I downloaded ubot as I have 30 day no question moneyback,just the standard version,it seems pretty hard to use,cant even find the if/then commands! watching some tutorials on youtube

delite737 said:

Hi,
I downloaded ubot as I have 30 day no question moneyback,just the standard version,it seems pretty hard to use,cant even find the if/then commands! watching some tutorials on youtube

Click to expand...

Did you buy Ubot or they have trail version? Nevermind play around a little bit with ubot dont focus on building what you need but on easy things like : register,login,if login pages exists then login,download to csv's,using lists tables etc etc. Just play with it and you will learn it in no time its relatively easy. Have fun.

todordonev said:

Did you buy Ubot or they have trail version? Nevermind play around a little bit with ubot dont focus on building what you need but on easy things like : register,login,if login pages exists then login,download to csv's,using lists tables etc etc. Just play with it and you will learn it in no time its relatively easy. Have fun.

Click to expand...

Hi,yes bought ubot,got a 30 day money back guarantee,I dont think this can work for me because from what I can see,it is a web browser based bot that can only crawl on what the web page on the ubot browser is displaying,which would be far too slow,impossibly slow,and it also cannot do simultaneous crawling,it does have a tab feature,so each one can run individually

I could of course be wrong on this but that is the impression I am getting from the first few tutorials
any know if I am right on this?

**BTW I want to reply to a few PM's but cant till I have 15 posts!!!

I sent you PM earlier. Waiting for reply to my email.

OP, have you tried any of the commercial programs/sites out there?

I think you will be looking at a lot more than $100.

Also which sites do you want mined?


Try some of these:
http://en.wikipedia.org/wiki/Data_mining#Software
http://en.wikipedia.org/wiki/Category:Data_mining_and_machine_learning_software

I'll do it for 100€, it doesn't really sound that hard if it is for one website only.

***UPDATE
I gave the job to sockpuppet
I only asked him two days ago,I wasn't sure if he was serious because he didn't really ask me much questions
He asked for higher than asking price(I didn't realize when posting offer,it was more complex than I thought)
and the project was much harder than my example of a few football teams,this was data of enormously bigger combinations and possibilities,I was genuinely still going through any offers just incase,because I wasn't been asked much questions,for a complicated operation,but he came back within a day with a fully functional demo,

**I HAVE RECEIVED THE SOFTWARE!!

I give a solid recommendation of Sockpuppet

Review of his work

*Simply I havn't been just gobsmacked like that in all my life,this is the most amazing,perfect,it is honestly better than perfect
It has extras,features and functionality of the data and the simple UI,but this is just shocking,it can do things I never asked for,lots of things I havn't thought of,

broke data down by in so many ways,all calculated

I mean I was using it half an hour before I discovered its full tricks and functionalities,its so simple and complex

After I gave him the test url,the result was back within a minute,it is just insane,

Also worth pointing out,to run it I just drag and drop a file on it and the ENTIRE process is taken care of,its totally magic

I really cant believe my money could hire someone with work of this quality

**Thanks anyone who asked for the job,and people who gave advice

OP from what I understand I think i have the program for you. I am going to post it in member downloads... and if whats you need why dont you throw me $20 if you can spare it.
The program is call Teleport ultra.

delite737 said:

I gave the job to sockpuppet
...

Click to expand...

thx, it's a pleasure to work with you

UPDATE**

received it!

absolutely fantastic job,really is top class

might write a proper review,but Im now going to bed

thanks again sockpuppet