1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Programmer for Simple Scraper

Discussion in 'Hire a Freelancer' started by bigbag, May 10, 2013.

Thread Status:
Not open for further replies.
  1. bigbag

    bigbag Newbie

    Joined:
    Apr 30, 2008
    Messages:
    47
    Likes Received:
    50
    I'm looking to hire a programmer for a simple scraper. I need to be able to input a list of keywords and scrape from the following source (replace "error" with keyword variable):

    http://autocomplete.support.microsoft.com/ACSearchSuggest.aspx?eleid=query&query=keyword

    The output should be a .txt file containing just the keywords denoted within the single quotes (don't need the numbers).

    Willing to pay $50 for this simple job, please PM me. Thanks!
     
    • Thanks Thanks x 1
  2. johnpup

    johnpup Regular Member

    Joined:
    Jan 31, 2013
    Messages:
    247
    Likes Received:
    29
    hello sir,

    i can do this for you. please add me on skype: walcott911 to talk more about the project.

    thanks and regards.
     
  3. xxMP3xx

    xxMP3xx Regular Member

    Joined:
    May 19, 2009
    Messages:
    368
    Likes Received:
    46
    Location:
    <?php return 'CPU'; ?>
    Just sent you a pm.

    Looking forward to work with you.
     
  4. blogbd1

    blogbd1 Jr. VIP Jr. VIP Premium Member

    Joined:
    Apr 19, 2008
    Messages:
    551
    Likes Received:
    353
    Location:
    Undetected
    Hi,

    I have created number of scrapers. Can complete this within few hours.

    Sent from my Samsung Galaxy Note II
     
  5. ringle

    ringle BANNED BANNED

    Joined:
    Dec 4, 2012
    Messages:
    20
    Likes Received:
    47
    Wow, $50 eh? You're a big spender!

    Really inspiring stuff. People spend years learning to program so they can make less than they would if they'd just applied to McDonalds rather than waste all those years.
     
    • Thanks Thanks x 2
  6. JFoulds

    JFoulds Power Member

    Joined:
    Apr 22, 2011
    Messages:
    538
    Likes Received:
    480
    Occupation:
    Genius billionaire playboy philanthropist
    This could literally be coded in under 5 minutes, and anyone who tells you it takes 'years' to learn to program either has never programmed before in their life or wouldn't have a high enough IQ to work at McDonalds.
     
    • Thanks Thanks x 2
  7. ringle

    ringle BANNED BANNED

    Joined:
    Dec 4, 2012
    Messages:
    20
    Likes Received:
    47
    It does take years to become a good programmer. Knowing how to write some basic programs in php doesn't make you a programmer. Come back when you can design and implement a SAAS with 100k lines of code that uses horizontally scaled databases and see if you still think you know what you're doing.

    And no, you couldn't code this in under 5 minutes. You're also not factoring in time writing documentation, or at least showing the client how to use the software, as well as actually gathering all the requirements and producing something he'll be happy with.

    Reading "Learn php in 24 hours" doesn't make you a software engineer.
     
  8. xxMP3xx

    xxMP3xx Regular Member

    Joined:
    May 19, 2009
    Messages:
    368
    Likes Received:
    46
    Location:
    <?php return 'CPU'; ?>
    Yes this can be designed under maximum 20 minutes.

    OP, let me know if you need it completed in this much amount of time :)

    Thanks.
     
  9. Mission Ashwamedh

    Mission Ashwamedh Junior Member

    Joined:
    Jul 4, 2012
    Messages:
    187
    Likes Received:
    118
    Occupation:
    Software Development and Internet Marketing
    I will do this for $30 and within an hour, with proxy support, multithreading etc..

    If still interested, send the pm...
     
  10. fatboy

    fatboy Elite Member

    Joined:
    Aug 13, 2008
    Messages:
    1,618
    Likes Received:
    3,227
    Occupation:
    Retired
    Location:
    Old Peoples Home
    Christ, think I need to get some bot making jobs from where you get them then. My custom work is generally $50 an hour and I sell small bots like this from my site starting at $5!

    So, where do you go to charge more for simple little bots then?
     
  11. JFoulds

    JFoulds Power Member

    Joined:
    Apr 22, 2011
    Messages:
    538
    Likes Received:
    480
    Occupation:
    Genius billionaire playboy philanthropist
    You said it 'takes years to learn how to program'. You are incorrect.
    'Learning to program' != 'becoming a good programmer'.

    As you're talking about a factual statement, you're just factually incorrect - your statement is wrong. It doesn't take people years to learn how to program, especially not to the extent required by the OP.

    Ironically enough, I've been working on a thin-client SaaS implementation in Django with horizontally scaling Postgres backend over the last few months, and it's about to be rolled out on a website currently hitting just under 1 million unique daily users - so I'd politely suggest you GTFO before you start running your mouth like a kid.

    The client wants a program that will scrape keywords from a URL based off a keyword, it's hardly going to be fucking complex documentation. In fact, I'm fairly sure I can predict the 'documentation' for the program someone eventually writes for him, here let me give it a shot:

    1) Type your keywords into the text box.
    2) Click the button
    3) Wait
    4) Keywords will appear in the text-box below


    Holy crap, that took all of 25 seconds.

    Let's say you're right, if I managed to mangle most of my fingers in a car door tomorrow and could only barely write out the ~30 lines of code this would require in 15 minutes, along with 15 minutes to write 4 lines of documentation.

    That puts my hourly wage at $100. According to statistics, the average number of worked daily hours for the USA is about 8 hours per working day with approximately 50 working weeks per year.

    That would put you on an average salary of $200,000 annually.
    Which, I dare say, is significantly above your pay grade.


    The OP posted an extremely basic request, with a very generous payout, especially when adjusted for a comparison to the average wage for a third-world country - so don't come and belittle him for no reason just to make yourself seem impressive because honestly - nobody cares.


    OP, If you haven't found someone to code this for you already I'll gladly do it, forgo the payment and donate the fee to a charity of BHW's choice based on a poll.
     
    • Thanks Thanks x 4
  12. jazzc

    jazzc Moderator Staff Member Moderator Jr. VIP

    Joined:
    Jan 27, 2009
    Messages:
    2,468
    Likes Received:
    10,148
    Oh, oh, horizontal scalability, big buzzword, everyone hide your women :D

    Playing with EC2 instances doesn't make one The Architect. :eek:

    You can't. It 's a piece of cake for any half-decent bot maker.

    Because one needs to write documentation on how to put a keyword and press click.
     
    • Thanks Thanks x 2
  13. Herion

    Herion Jr. VIP Jr. VIP Premium Member

    Joined:
    Jul 8, 2012
    Messages:
    288
    Likes Received:
    72
  14. ringle

    ringle BANNED BANNED

    Joined:
    Dec 4, 2012
    Messages:
    20
    Likes Received:
    47
    Congratulations. You know how to use Google.

    Now that is very amusing indeed. The fact you think $200k is a lot of money and something significantly above my "pay" grade brings me an inner joy. Thank-you for that. The reality is I actually pay my VP of Engineering more than that alone never mind the rest of my team or what I take home myself.

    Stick with finding $50 jobs on blackhatworld little bud. Good luck!


    "horizontal scaling" isn't a buzzword. You're thinking of no-sql garbage that isn't actually practice in the real world. I'd start with this youtube video v=b2F-DItXtZs

    If you'd setup database partitioning before you would know that you can't just add more ec2 instances. It's an extremely difficult thing to setup and a specialist field all by its self.


    There's no point even getting into this. The fact you think you can scale sql databases by adding more ec2 instances kind of gives the game away that you don't know what you're talking about. I've also never heard any engineers refer to themselves as "bot makers" either.


    Anyway, please just go ahead and ban me from this god-awful forum. Not only are 99.9% of you utterly clueless about marketing, but apparently engineering too.

    I'm already worth 7 figures so this forum has absolutely no value for me whatsoever.


    Thanks.
     
    Last edited: May 11, 2013
  15. thedorf

    thedorf Senior Member

    Joined:
    Oct 1, 2008
    Messages:
    1,193
    Likes Received:
    700
    Occupation:
    what? I gotta have a job?
    Location:
    BHW - Where else?
    Easy mate, we're all trying to get somewhere. Would be interested to hear what you are willing to share.
     
  16. kbrouder

    kbrouder Newbie

    Joined:
    Apr 25, 2013
    Messages:
    20
    Likes Received:
    4
    This is why these bots break all the time. You could code this in under an hour if you had a framework for a similar bot and just needed to make some adjustments, but even something as simple as this, you should be sanitizing any user input and handling any possible errors. Most people skip over these steps and it results in their bot breaking.
     
    • Thanks Thanks x 1
  17. smitha

    smitha Registered Member

    Joined:
    Oct 13, 2009
    Messages:
    61
    Likes Received:
    39
    Home Page:
    by the way what is that output , some keyword search data fron Bing ?
     
  18. jazzc

    jazzc Moderator Staff Member Moderator Jr. VIP

    Joined:
    Jan 27, 2009
    Messages:
    2,468
    Likes Received:
    10,148
    That 's so ignorant, I don't know where to begin to comment it. You can freely admit it, the only reason you 're bashing NoSQL is because you can't wrap your head around it.


    Again, it 's difficult for you. Don't extrapolate your weakness around to make your e-dick harder.

    That 's what you assumed because that 's how shallow your education is.

    Skills trump words, in case you haven't realized.

    Only reason one can get banned is by breaking the rules. That said, feel free to spend your 7 figure time somewhere where people buy your crap stories.


    You 're welcome.
     
    • Thanks Thanks x 4
  19. JFoulds

    JFoulds Power Member

    Joined:
    Apr 22, 2011
    Messages:
    538
    Likes Received:
    480
    Occupation:
    Genius billionaire playboy philanthropist
    If I could infinitely +rep you for that, I would bahaha.

    I'll gladly answer any other questions you have, unlike some people I have more skill than just throwing out bullshit and buzzwords and hoping people pay me attention.


    I would almost have believed this line if you hadn't said that me thinking $200k is a lot of money brings you inner joy. Sorry, $200k is a lot of money to anyone. I know plenty of international venture capitalists who wouldn't scoff at a $200k investment, so yeah, stop talking shit.

    Unlike you, who has offered absolutely nothing to this forum besides belittling and bullshit, I have offered already to do this job free of charge and donate the fee to a charity of BHW or the OP's choice. Understandably, it would take you significantly longer than me to perform this task, so I can understand you wouldn't want to waste hours doing unpaid work, but for me, I can gladly spare 5 minutes in my lunch break to do some charity work and help a fellow BHW member.


    As said by jazzc, this just exposes your utter ignorance. NoSQL is used by a hell of a lot of major companies (I've got experience with MongoDB, but I'm sure there are other widely implemented solutions) and frankly, your view that it 'isn't actually practiced in the real world' makes me laugh.

    I don't manage any of my databases using EC2, it's much more effective to use Amazon RDS when dealing with cloud hosting AWS, I'd rather not waste time updating daemons all afternoon.


    The OP isn't asking to hire a Cambridge CompSci PhD graduate to develop a 10 million line scalable code implementation to manage half a billion active users, he's asking for someone to make him a bot. That's like saying you've never seen any artists refer to themselves as 'painters' when someone is looking to hire an individual to paint their shed.

    Honestly, you're not even worth the mouse click it would take to do that. Nobody cares about your attention whoring. Frankly, I couldn't give a shit if you make $10,000,000 per year or $10. You're not conducive to the atmosphere we strive for in this community and no amount of capital will help you with that. You'll be a jackass regardless of your salary.

    Cool story bro. I have absolutely no doubt that there are numerous BHW members who are worth a great deal more than you, and a large number that are worth a lot less than you. Personally I don't judge anyone by 'how much they are worth', and the very fact that you consider this a good measure of a person exposes your ignorance and stupidity. There are many, many thousands of people who are a lot more intelligent than you that earn a great, great deal less than their potential. If someone can teach me something, I don't care if they're a multi-billionaire or a pauper. Capital cannot serve as a replacement for knowledge.
     
  20. jimbobo2779

    jimbobo2779 Jr. VIP Jr. VIP Premium Member

    Joined:
    Sep 17, 2008
    Messages:
    3,239
    Likes Received:
    2,395
    Occupation:
    Software Engineer
    Location:
    UK
    Home Page:
    Anyone else feel like they took a wrong turn somewhere?
     
    • Thanks Thanks x 1
Thread Status:
Not open for further replies.