cross domain iframe scraping

W

wseo12

Regular Member
Joined
May 23, 2009
Messages
221
Reaction score
7
whats up guys I need a script that can scrape an iframe the iframe is on my site the src of the iframe leads to another site I have been having trouble trying to find a script that can do this I would really appreciate if some one can provide me with a script or some sample code how I can go about scraping a cross domain iframe thanks

I tried doing it in javascript I don't think a browser based language will work I was thinking a server side language such as php should work
 
Advertise on BHW
I would really appreciate if some one will contribute I really need help i have been stuck on this for a while.
 
over 80 views and not one reply I know some one on here can help thanks
 
Why not just use php's file_get_contents / curl?

it will be like:
Code: 
<?php
$url = 'youriframeurl';
echo file_get_contents($url);?>
instead of
Code: 
<html>
<iframe src="youriframeurl"/>
</html>

let me know if you need a curl req instead of the built in function.
 
Do you know how to do any programming? I've done some of this screwing around with the browser control in c#. They try to 'protect' from cross-site scripting attacks, its one of the few protections that javascript has in the browser.

Also, you might be able to disable cross-site scripting protection using PhantomJS. Check out PhantomJS.

gtownfunk
 
I was answering under the assumption that its not as simple as just requesting the URL in the iframe in this case. That would clearly be the simplest and if that works without a problem.. then agreed, do g0g0ls script. If some javascript needs to be run in the context of the iframe or in the iframe src url that's not going to work, though.

gtownfunk
 
hi yea I would consider my self advanced in php and intermediate in javascript gtownfunk was the best reply I already used curl but this will not work because when I call the page with curl the browser session gets lost my whole purpose for this is I need the browser session to be active as I am trying to scrape an email from the iframe and the email only displays in an iframe but does not display when I call it with curl because curl is a browser the session is new with curl

I want the email so I can display it on my page for example welcome sampleemail@yahoo. and another big reason I need it is so I can prepopulate my form with the user email if you get what if saying (;
 
Last edited:
Use AJAX.

Code: 
$.ajax({
                url: 'http://www.thewebsitewithiframe.com'
                type: 'POST',
                crossDomain: true,
                data: {email:email },
                success:function(data){
                     $("#email").html(data);                
                },
                error:function(xhr,status,error){
                    alert(status);
                }
});

I'm not great with AJAX and this is an abstract example, but I think you can call file_get_contents using cross domain AJAX. Might wanna look into AJAX and check stackoverflow.
 
To have that working, the other domain needs to allow cross origin calls. It will have issues with IE < 9 too.
Chakeda said:
Use AJAX.

Code: 
$.ajax({
                url: 'http://www.thewebsitewithiframe.com'
                type: 'POST',
                crossDomain: true,
                data: {email:email },
                success:function(data){
                     $("#email").html(data);                
                },
                error:function(xhr,status,error){
                    alert(status);
                }
});

I'm not great with AJAX and this is an abstract example, but I think you can call file_get_contents using cross domain AJAX. Might wanna look into AJAX and check stackoverflow.
Click to expand...
 
Yeah, I'd look at doing it in C# with a webbrowser control or like I said, look into PhantomJS.

gtownfunk
 
gtownfunk said:
Yeah, I'd look at doing it in C# with a webbrowser control or like I said, look into PhantomJS.

gtownfunk
Click to expand...



Thanks gtownfunk I will look into phantomjs will phantomjs solve cross domain issues plus keep all session data ?
 
If it doesn't let you do the cross domain scripting out of the box there are compiled binaries floating around that have this security feature disabled.

It'll keep session data, but it'll be a slightly different way of looking at things. Your current code might work just fine though.

gtownfunk
 
gtownfunk said:
If it doesn't let you do the cross domain scripting out of the box there are compiled binaries floating around that have this security feature disabled.

It'll keep session data, but it'll be a slightly different way of looking at things. Your current code might work just fine though.

gtownfunk
Click to expand...

thanks gtownfunk I appreciate it any idea where I can get the compiled binaries
 
wseo12 said:
I already used curl but this will not work because when I call the page with curl the browser session gets lost my whole purpose for this is I need the browser session to be active as I am trying to scrape an email from the iframe and the email only displays in an iframe but does not display when I call it with curl because curl is a browser the session is new with curl

I want the email so I can display it on my page for example welcome sampleemail@yahoo. and another big reason I need it is so I can prepopulate my form with the user email if you get what if saying (;
Click to expand...

Since you don't have control over the iframe the same-origin policy will totally prevent the sort of thing your looking to do... no ifs, ands, or buts. So outside of some super rare third party information leakage/SOP bypass browser vulnerability, it's 100% impossible.
 
Advertise on BHW
You must log in or register to reply here.
Sign up now!

Main Menu

Home Main Forum List Black Hat SEO White Hat SEO BHW Newbie Guide Blogging Black Hat Tools Social Media Downloads

Marketplace

Account Selling Content / Copywriting EBooks / Methods Hosting Misc Proxies For Sale SEO - Link building SEO - Packages Social Media Social Media - Panels Web Design More

Making Money

Affiliate Programs Hire a Freelancer IM Journeys Making Money Pay Per Click Site Flipping Want to Buy

BlackHat World

Dispute Resolution Forum Suggestions & Feedback Introductions Lounge
Back
Top