1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Wanna make a shopping sites scrapper websites to Compare prices - Which language to use ?

Discussion in 'General Programming Chat' started by bsbimalbose, Aug 3, 2013.

Tags:
  1. bsbimalbose

    bsbimalbose Newbie

    Joined:
    Jul 14, 2013
    Messages:
    2
    Likes Received:
    0
    I wanna know which is the fastest language that i can use to do the scarping. Must be fairly easy to code. Any suggestions guys??
     
  2. divok

    divok Senior Member

    Joined:
    Jul 21, 2010
    Messages:
    1,041
    Likes Received:
    639
    Location:
    .IN
    Don't know about fastest , but easy to code is python and its scrapy library . I suggest to start with beautifulsoup first .
    I also created a price comparing website , let me tell you there are hundreds of such website and competition is very tough , and google hates such websites.
     
  3. 312k1t

    312k1t Registered Member

    Joined:
    Oct 26, 2012
    Messages:
    59
    Likes Received:
    6
    I have to agree with divok. There are services which merge product feeds from merchants to one database and provide them in the API. So almost everyone with a few coding skills can create this type of site.