1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

(Help) Display Remote Page

Discussion in 'BlackHat Lounge' started by EagleRose, Feb 11, 2011.

  1. EagleRose

    EagleRose Jr. VIP Jr. VIP Premium Member

    Joined:
    Apr 11, 2009
    Messages:
    107
    Likes Received:
    200
    Occupation:
    Exercising fingers on kb
    Home Page:
    Hi Peeps,
    I am in the middle a designing a site for a client. I need to display content provided by a 3rd party source. They do not provided a RSS or an XML feed, So I need to grab the remote pages by URL.

    When I first proposed the new site, I thought I was going to use IFrame, which I know would work, but I do not get the SEO properties of the content I am trying to display on the site. This I did not learn until later.
    Obviously, I am trying to SEO as much of the site as I can.

    I am looking for a way to grab remote content and display the said content on the local webpage. Grab the content each once every 24 hours to make sure it fresh or when the page is accessed by customers. (may slow load times though.
    I am using WP for the site. So, what ever method used needs to work with WP, either a plug in or some code.

    I am asking if anyone knows how to accomplish this task. I have googled around and found that PHP and Curl can get the job done, but I do not jack squat about curl and very little about php, nor could I find and ready made code I could use to start with.

    I did find a plugin (wp-web-scrapper.2.6) that is supposed to do what I am trying to do, but I cold not get it work correctly. It would only grab the text from the remote and nothing else.

    Even you cold give some pointer, or is you have a script or someway of making this happen, it would be greatly appreciated.

    Thanks,
    EagleRose