1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Google crawler / Bot for Magento websites

Discussion in 'Hire a Freelancer' started by grendmesta, May 31, 2017.

  1. grendmesta

    grendmesta Newbie

    Joined:
    May 29, 2017
    Messages:
    4
    Likes Received:
    0
    Who can help me with a bot that can do the following:

    1. crawl Google and find Magento CMS sites in a specific country .
    2. if found, than check which Magento version the site is using,
    3. than you check if the Magento site is outdated
    4. check which security patches these sites need
    5. if the site is outdated than fetch email address + Telephone nr. (go that site's contact or about me page)
    6. gather the data and put in a spreadsheet or database

    Currently I do this manually by using google dorks , magento footprints
    When I have found the URL in google than I use this online magento tool 'magereport' to check which patches the site needs.

    I am new here so excuse in advance for talking newbie language
     
  2. Subrajit Dey

    Subrajit Dey BANNED BANNED

    Joined:
    Apr 17, 2017
    Messages:
    33
    Likes Received:
    3
    Gender:
    Male
    Hi, I can create this bot for you. Add me on skype live:hansi01314
     
    • Thanks Thanks x 1
  3. Repulsor

    Repulsor Power Member

    Joined:
    Jun 11, 2013
    Messages:
    768
    Likes Received:
    276
    Location:
    PHP Scripting ;)
    Thats a really nice way to make some money. :)
     
    • Thanks Thanks x 1
  4. grendmesta

    grendmesta Newbie

    Joined:
    May 29, 2017
    Messages:
    4
    Likes Received:
    0
    I have not received anything, so please refund .
    thank you.
     
  5. yellowcat

    yellowcat Regular Member

    Joined:
    Aug 27, 2015
    Messages:
    303
    Likes Received:
    173
    Location:
    internet 24/7
    Home Page:
    I can code this add me on skype, yellowcat1771
     
  6. Dan21

    Dan21 Registered Member

    Joined:
    Aug 13, 2016
    Messages:
    68
    Likes Received:
    4
    Gender:
    Male
    I have crawled google before for different reasons, I can make a crawler for Magento, it will not be an issue for me. If you want to discuss more message me.

    My Skype is:
    live:de094fb9fc4321e1

    About my work:
    I build scallable multithreaded solutions in Python or Java for cloud servers (AWS, GCP, DO). Front end of your preference, web application (HTML+CSS+Jquery) responsive or a desktop GUI application. Deployment management, local database or scallable database solution. Whatever kind of bot you need or automation script, reverse engineering I can make it, as long as you are a serious buyer and are willing to pay hourly (50$/hour for non-emergency projects 80$/hour for overnight emergency projects). I work more than 60 hours a week doing this and you will get what you need really fast. No delays, no confusion, open communication 16 hours a day. Are you on a different timezone? Not a problem I will adjust if necessary to your work hours. I have years of experience :)
     
  7. jamie3000

    jamie3000 Supreme Member

    Joined:
    Jun 30, 2014
    Messages:
    1,345
    Likes Received:
    610
    Occupation:
    Finance coder looking for semi-retirement
    Location:
    uk
    Have you ever had anyone on bhw willing to pay you that rate? I'm not saying you're over priced, as I'm from the UK I know that's a pretty standard rate for a good developer but I picture bhw people shitting themselves when they know how much a good non-third world country developer costs.
     
    • Thanks Thanks x 1
  8. Dan21

    Dan21 Registered Member

    Joined:
    Aug 13, 2016
    Messages:
    68
    Likes Received:
    4
    Gender:
    Male
    I am glad you asked this question.

    Most of BHW members are freeloaders. No trying to offend the community, I think I am pointing the obvious. but there are definitely some serious business people here. I have done long term work with at least 3 people I can remember, that I met from here. If you want to make money you need to spend money. Also for most cases the amount someone ends up paying me on 50$/hour is the same as the indian guy that asks for 10$/hour and takes 5 times as long to do the same job, also you save money from having to hire someone else to fix the mess the previous guy made (I was hired more times than I can remember to fix situations like that). I like to think my work as an investment and serious people are willing to pay it. I have helped people make $$$,$$$ and it is something I am happy about and proud for. Finally, compared to what other people with my skillset are charging, this is too low. I have friends that charge 80$ and 100$ hourly. Also this kind of work is the same as you would buy a bottle making machine for example. You can buy a cheap Chinese machine knock-off with bad engineering, that will make you 1000 bottles before breaking down or you can buy a german engineered machine that will run even after you die. Smart business people understand the value of the work and would pay much more than what I am charging to be honest.

    So to answer your question directly, there are many factors you need to consider but most if not all of the times working with someone with my skill-set and price level is the best choice you can make.
     
  9. payal23j

    payal23j Jr. VIP Jr. VIP

    Joined:
    Aug 19, 2009
    Messages:
    779
    Likes Received:
    86
    Gender:
    Female
    Location:
    VA and expert in data entry !!
    Do you need VA to do this manual task for you?

     
  10. sam.hunt0710

    sam.hunt0710 Jr. VIP Jr. VIP

    Joined:
    Feb 22, 2011
    Messages:
    4,887
    Likes Received:
    1,801
    Gender:
    Male
    Occupation:
    Owner Of a IT Comapny
    Location:
    India
    Hello @grandmesta Drop me a PM so that we can discuss further or send me your skype ID.
     
  11. handmadebots

    handmadebots Senior Member

    Joined:
    Nov 8, 2012
    Messages:
    961
    Likes Received:
    217
    Home Page:
    Still looking ? Add me on skype: workhardph
     
    • Thanks Thanks x 1