1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

How to scraping? plz help to find out the Path of it..

Discussion in 'Web Design' started by sohom, Aug 6, 2013.

  1. sohom

    sohom Senior Member

    Joined:
    May 26, 2013
    Messages:
    981
    Likes Received:
    175
    Location:
    not in Past
    Hello
    I want to integrate IMDB & Wikipedia on my PHP Site.
    What I exactly want to do.
    Just by providing a valid imdb link ,I want to grab all major details of that movie & want to display in my website with HTML.
    I think Word scraping is the right thing , what I am looking for! If I am wrong please correct me, thanks in advance :)

    I want to know the path of Web/Data Scraping.

    I had worked with DOM.(little bit)

    And my background is Computer Science,its my bad that I don/t know scraping.
    So I know PHP,MYSQL,Basic JAVA,Javascript,JQuery(basic),AJAX.

    is scraping required python knowledge?

    If there is paid online Tutorial(like lynda.com) for that course, I am ready to buy it.
    or refer me anything related to that [ebooks/books/site,etc]


    Thank you guys.
     
  2. methylenebl

    methylenebl Newbie

    Joined:
    Aug 6, 2013
    Messages:
    22
    Likes Received:
    5
    Hello there


    Web scraping can be kinda troubling at first glance, but I promise it is a pretty ez concept


    First advice is a service like IMDB is pretty big so im pretty sure they have either an official or unofficial API you can probably query


    AKA
    omdbapi
    mymovieapi


    Which is a JSON response so you can use


    json decode and boom you have an array


    Usually HTML scraping you would just make a helper class anyways to return json array like responses


    Though if you are looking to just HTML scrape the sites you could use this PHP helper library to do most of the heavy lifting for you


    simplehtmldom


    though if you do not have to HTML Scrape you probably shouldn't as it is kinda slower depending on how much of the information you have to scrape
     
    • Thanks Thanks x 2
  3. sohom

    sohom Senior Member

    Joined:
    May 26, 2013
    Messages:
    981
    Likes Received:
    175
    Location:
    not in Past
    Thanks for the reply mate
    Do you or any 1 know any Tutorial/course site or Book/ebook (Paid or Free Does not matter) related to Scraping

    Thanks in advance
     
  4. spider7

    spider7 Regular Member

    Joined:
    Feb 6, 2013
    Messages:
    333
    Likes Received:
    46
    Oh man...i just posted a related topic above (*sigh). Oh well...yes a tutorial would be great. Let me see if there's any on You Tube.
     
    • Thanks Thanks x 1
  5. sohom

    sohom Senior Member

    Joined:
    May 26, 2013
    Messages:
    981
    Likes Received:
    175
    Location:
    not in Past
    yes some on youtube - by python
    But I want a Guide book/ inline course to get in
     
  6. TheeAriGrande

    TheeAriGrande Regular Member

    Joined:
    Jul 14, 2013
    Messages:
    270
    Likes Received:
    151
    Location:
    Candlestick Park
    PHP is easy to use when scraping. DOM makes it even easier. The question is: Do you want to query the IMDB directly or do you want to query some sort of movie API?

    Add me on Skype if you want to have a quick chat.

    EDIT: By the way, I have plenty experience when it comes to scraping && PHP.
     
    • Thanks Thanks x 1
  7. sohom

    sohom Senior Member

    Joined:
    May 26, 2013
    Messages:
    981
    Likes Received:
    175
    Location:
    not in Past
    added you mate on skype :)
     
  8. Gogol

    Gogol Elite Member

    Joined:
    Sep 10, 2010
    Messages:
    3,062
    Likes Received:
    2,872
    Gender:
    Male
    That's easy with PHP. Search for "Simple HTML DOM" class in google. It will make your job even easier. Also make sure that you use proxy with each request (you might need to modify Simple HTML DOM class to be able to do it) so that IMDB doesn't fry your ass lol.
     
    • Thanks Thanks x 1
  9. sohom

    sohom Senior Member

    Joined:
    May 26, 2013
    Messages:
    981
    Likes Received:
    175
    Location:
    not in Past
    thanks mate
     
  10. legitnoobie

    legitnoobie Newbie

    Joined:
    Sep 9, 2013
    Messages:
    7
    Likes Received:
    1
    I got your PM but I'm not able to PM you back. send me an email akionz619 yahoo