1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

I need some custom scraping done . . . whos the best here to work with?

Discussion in 'General Programming Chat' started by monsterclicks, May 15, 2014.

  1. monsterclicks

    monsterclicks Jr. VIP Jr. VIP Premium Member

    Joined:
    Jul 1, 2009
    Messages:
    1,078
    Likes Received:
    714
    Home Page:
    Basically I have a list of product ID for XYZ manufacture.

    I need to take these products ID's and scrape the product description.

    Any recommendations who can do this?
     
  2. knockoutlocal

    knockoutlocal Junior Member

    Joined:
    Jun 5, 2012
    Messages:
    160
    Likes Received:
    67
    Seems very simple. I guess it depends on where the information is located and whether you have to jump through captchas, e-mail confirmations, etc to get to it.

    If you have some programming experience or you use ubot/zennoposter I can walk you through it.
     
  3. bicyclethief

    bicyclethief Newbie

    Joined:
    May 29, 2014
    Messages:
    25
    Likes Received:
    8
    knockoutlocal is right that it depends on how accessible the data is. If it is just sitting there on a public site it should be very easy though. If you know Python, I would recommend Scrapy. If the site is straightforward, it's probably about 20 minutes work for someone who knows what they are doing.