1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Custom Website Scrapper

Discussion in 'Hire a Freelancer' started by TeKn1qu3z, Jun 2, 2017.

  1. TeKn1qu3z

    TeKn1qu3z Jr. VIP Jr. VIP Premium Member

    Joined:
    Jul 26, 2012
    Messages:
    916
    Likes Received:
    231
    Occupation:
    Amazon FBA Guru
    Location:
    The Office
    I need a custom website scrapper to pull financial data from different websites.

    Also needed is a quick way to upload this scraped data back up to my own website.

    Maybe the best way is API, need developer thoughts on this. The other way I am thinking about it is storing the data in mysql.

    Thanks,
     
  2. bananaman5000

    bananaman5000 Regular Member

    Joined:
    Mar 5, 2010
    Messages:
    201
    Likes Received:
    130
    look up the simple dom html parser, it's a php object and will save you hours of time. it lets you select html elements kind of like jQuery
     
  3. orkney

    orkney Newbie

    Joined:
    Sep 26, 2016
    Messages:
    16
    Likes Received:
    13
    Gender:
    Male
    Occupation:
    Web Developer
    Location:
    Orkney Islands
    I built something similiar using Ubot Studio :) I built a price checker which scrapes competitor prices daily and imports them into mysql so I can track price changes through a GUI.
     
  4. SEODEMON

    SEODEMON Regular Member

    Joined:
    Sep 15, 2010
    Messages:
    238
    Likes Received:
    74
    You need PHP and Curl
     
  5. TactSports

    TactSports Newbie

    Joined:
    Jun 1, 2017
    Messages:
    36
    Likes Received:
    0
    Gender:
    Male
    PHP works wonders
     
  6. RoiBox

    RoiBox Regular Member

    Joined:
    Apr 4, 2009
    Messages:
    237
    Likes Received:
    164
    Occupation:
    Internet Entrepreneur
    Location:
    Gothenburg | Sweden
    Home Page:
    Use Diggernaut.com they built a scraper for me and it only cost me $40, you can have their free service or compile the digger and run it from your own computer if you want .. Look them up, I am very happy with their service so far .. Made me a lot of money with my custom built digger at only $40 - It may vary if your digger is more complex in cost, but they are cheap .. =)

    Good luck there ..
     
  7. SMMSnab

    SMMSnab Registered Member

    Joined:
    Mar 30, 2017
    Messages:
    91
    Likes Received:
    20
    Gender:
    Male
    Occupation:
    SMM aficionado
    Home Page:
    @TeKn1qu3z you can always use webscraper dot io - free chrome extension that scrapes any data you need and export it into csv/xls
    then you can import it using sqlizer dot io - convert csv into mysql import script, that can be run in phpMyAdmin