1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Wanna make a shopping sites scrapper websites to Compare prices - Which language to use ?

Discussion in 'General Programming Chat' started by bsbimalbose, Aug 3, 2013.

Tags:
  1. bsbimalbose

    bsbimalbose Newbie

    Joined:
    Jul 14, 2013
    Messages:
    2
    Likes Received:
    0
    I wanna know which is the fastest language that i can use to do the scarping. Must be fairly easy to code. Any suggestions guys??
     
  2. divok

    divok Senior Member

    Joined:
    Jul 21, 2010
    Messages:
    1,015
    Likes Received:
    634
    Location:
    http://twitter.com/divok
    Don't know about fastest , but easy to code is python and its scrapy library . I suggest to start with beautifulsoup first .
    I also created a price comparing website , let me tell you there are hundreds of such website and competition is very tough , and google hates such websites.
     
  3. 312k1t

    312k1t Registered Member

    Joined:
    Oct 26, 2012
    Messages:
    56
    Likes Received:
    5
    I have to agree with divok. There are services which merge product feeds from merchants to one database and provide them in the API. So almost everyone with a few coding skills can create this type of site.