1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Script Writer Wanted / Web Crawler/Scraper

Discussion in 'Hire a Freelancer' started by hamd01, Oct 6, 2014.

  1. hamd01

    hamd01 Jr. VIP Jr. VIP Premium Member

    Joined:
    Mar 29, 2010
    Messages:
    560
    Likes Received:
    127
    This is a fairly flexible project, in that I don't care how it is done...as long as the end results are the same.

    I need a script that will crawl the web, for MAGENTO websites...i.e ecommerce sites running on the Magento platform. I'm not really bothered how it is done.... but the end result must be as follows;

    The output will be written to a Google Doc Spreadsheet file, and it will contain the following fields;

    Website URL
    Is Website Responsive (yes/No)
    TITLE tag

    The script must run from a windows based PC, and at runtime will have the following options;

    'Search String' - This is the string that will be used to search Google. For example, if I type in 'cars' the script would populate the Google spreadsheet with a list of "car" related Magento websites.

    'domain limiter' - For example, we may only want to search for .co.uk site or .com

    HINT: It's fairly easy to identify Magento sites by going to /admin and seeing if the word "Magento" exists.

    Anyone who can code this script, drop me a pm?
     
  2. gabrava

    gabrava Newbie

    Joined:
    Feb 8, 2013
    Messages:
    22
    Likes Received:
    3
    Location:
    Africa
    Hi BHW Freelancers, please i need a bot that would run on windows platform that will research for the top selling items and products i wish to sell on an local ecommerce site like konga dot com Having to go through various categories and stores to check how much of an item that has been sold is very time consuming. The Selling Platform they used is not like amazon or some other ones. Researching for the top most selling items on konga. it is built on magento enterprise. The script must run from a windows based PC, and at runtime will have the following options;

    'Search String' - This is the string that will be used to search and return most typed keywords and stores with the most number of sales

    Anyone who can code this script, please do drop me a pm
     
  3. fidodido

    fidodido Junior Member

    Joined:
    Aug 12, 2015
    Messages:
    113
    Likes Received:
    27
    Send me a PM with details on how you do this manually (every step you do, if you can record a video and share it with me, that would be wonderful), and I will see if I can write this for you.
     
  4. MrBlue

    MrBlue Senior Member

    Joined:
    Dec 18, 2009
    Messages:
    950
    Likes Received:
    662
    Occupation:
    Web/Bot Developer
    This sounds fun. Reach out to me on skype: i_m_mrblue
     
  5. gabrava

    gabrava Newbie

    Joined:
    Feb 8, 2013
    Messages:
    22
    Likes Received:
    3
    Location:
    Africa
    any update from you guys. i am still waiting