1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Best Website Data Scapper

Discussion in 'Scripting' started by thekingofwholesale, Mar 7, 2017.

  1. thekingofwholesale

    thekingofwholesale Registered Member

    Joined:
    Dec 24, 2015
    Messages:
    67
    Likes Received:
    10
    Gender:
    Male
    Occupation:
    Entrepreneur
    Location:
    Michigan
    Home Page:
    I am looking for an easy to use website data scraper that I can use to scrape my website. I am trying to pull the data from my website so I can use it for dynamic remarketing with adwords and have the data put into the proper colums in a .csv file.

    The closest I have found to what I was looking for is import.io but there software has issues loading some of my data/pages since my site uses API.

    Any help would be appreciated.
     
  2. Blacklistede

    Blacklistede Newbie

    Joined:
    Oct 19, 2016
    Messages:
    38
    Likes Received:
    1
    If you only need to scrape your website, hiring someone to code you a scraper would be the best thing in my opinion. This will give you the fastest results with exactly the things you need.
    Also, it should be cheaper than buying some general scraping software which will only do a poor job.
     
  3. koleinz

    koleinz Junior Member

    Joined:
    Oct 3, 2015
    Messages:
    141
    Likes Received:
    22
    Scrapebox is worth the 47$
     
  4. what_hat?

    what_hat? Jr. VIP Jr. VIP

    Joined:
    Sep 1, 2012
    Messages:
    200
    Likes Received:
    103
    Gender:
    Male
    Location:
    CET
  5. Cozmo

    Cozmo Newbie

    Joined:
    Apr 16, 2017
    Messages:
    18
    Likes Received:
    2
    You could possibly write your own scraper , probably it won't be that difficult. (Cheeio + NodeJS) or Scrapy might do the job.
     
  6. Gokulanand

    Gokulanand Newbie

    Joined:
    Feb 12, 2017
    Messages:
    23
    Likes Received:
    1
    Gender:
    Male
    PM me. and I'm ready to help you.
     
  7. rafark

    rafark Regular Member

    Joined:
    Jan 15, 2013
    Messages:
    403
    Likes Received:
    189
    Gender:
    Male
    Occupation:
    Moderador
    Location:
    Noble and Heroic MC
    If it is your website the best option is to extract the data straight from your database. Assuming you're using a SQL database, you can construct a query to do just what you want, and depending on your RDMS you can even get the data straight to a file, including a coma separated value file.
     
  8. wowregister

    wowregister Junior Member

    Joined:
    Jan 15, 2010
    Messages:
    141
    Likes Received:
    17
    Location:
    Canada/US
    Scrapy is pretty cool, I used it a couple years back