1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

scrapping

Discussion in 'Pay Per Click' started by Bennylearning, May 29, 2017.

  1. Bennylearning

    Bennylearning Registered Member

    Joined:
    May 13, 2017
    Messages:
    66
    Likes Received:
    8
    Gender:
    Male
  2. Repulsor

    Repulsor Power Member

    Joined:
    Jun 11, 2013
    Messages:
    770
    Likes Received:
    279
    Location:
    PHP Scripting ;)
    Now that is some serious amount of data, with lot of fields to scrape. You wont really be able to find a scrapper that can do it on its own. Your best bet is to hire a programmer who can scrape it for you.

    If you just want to copy the website as a whole, you can try using httrack, but that doesnt give you the datas into an excel or a database, but would only copy the page as is. Do let me know if you need to get it done.
     
  3. Carlos TV

    Carlos TV Regular Member

    Joined:
    Jan 19, 2016
    Messages:
    267
    Likes Received:
    68
    Location:
    Spain
    Do you know Import.io?
     
  4. Bennylearning

    Bennylearning Registered Member

    Joined:
    May 13, 2017
    Messages:
    66
    Likes Received:
    8
    Gender:
    Male
    once the site is copied, would it not save the data on server and then we can make somthing out of there, to give feed to my sites i want with that data
     
  5. Repulsor

    Repulsor Power Member

    Joined:
    Jun 11, 2013
    Messages:
    770
    Likes Received:
    279
    Location:
    PHP Scripting ;)
    Having the site copied would be same as using the current site. There would be no difference at all. I mean, it wont give you all the data into an excel or a database. It would just save the pages as is, which is what you have in the site now.
     
  6. wilihost

    wilihost Registered Member

    Joined:
    May 24, 2017
    Messages:
    99
    Likes Received:
    14
    Gender:
    Male
    I think what he means is using the site as basis for real time values that will be forwarded to his sites. Probably won't be using it for himself but will be "borrowing" the data for his sites.
     
  7. wilihost

    wilihost Registered Member

    Joined:
    May 24, 2017
    Messages:
    99
    Likes Received:
    14
    Gender:
    Male
    You'll need to hire programmers that specialize in web scraping and creating a script that will run on your server and collect the data from the site and throw them onto your own sites. You can hire one here in this forum or on other freelancing platforms.
     
  8. Bennylearning

    Bennylearning Registered Member

    Joined:
    May 13, 2017
    Messages:
    66
    Likes Received:
    8
    Gender:
    Male
    Yes you are right i need a progammer. thanks for your advise boss, i have to come back to this point in few days time
     
  9. pixelspirit

    pixelspirit Newbie

    Joined:
    Jan 8, 2014
    Messages:
    2
    Likes Received:
    0
    I can scrape it for you, what do you need all of the data for? for an app ?
     
  10. bartosimpsonio

    bartosimpsonio Jr. VIP Jr. VIP Premium Member

    Joined:
    Mar 21, 2013
    Messages:
    12,489
    Likes Received:
    11,190
    Occupation:
    CHEAP
    Location:
    DATASETS
    Home Page:
  11. Debian

    Debian BANNED BANNED Jr. VIP Premium Member

    Joined:
    Feb 17, 2009
    Messages:
    1,273
    Likes Received:
    554
    You can scrape high volume if you have a shit ton of different ip's. Also something to consider in this equation.
     
  12. Repulsor

    Repulsor Power Member

    Joined:
    Jun 11, 2013
    Messages:
    770
    Likes Received:
    279
    Location:
    PHP Scripting ;)
    24*7 running a PHP Scrapper with TOR is what I use when I can allow some errors/missing data. Or ProxyRental instead of TOR( with its on call IP rotation feature,just like in TOR) when I want more reliability.