php curl

Hi all , I have this idea in mind long time ago , since first time I know about php and curl , any way I found this sitemap generator thats crawl entire site and literally grape all it pages links , I run it on one site an it grape ~8k pages ling (it was big site ) , this script name is Simple...

Hi, I would like to grab all links of a webpage with PHP curl using XPath. My code is well working but when it's a nofollow link, my script is "printing" "nofollow" :confused: How can I do to "force" my script to follow this kind of links ? Regards,

I have a php script $config['proxy'] = 'website with numerical port number'; $config['proxy_username'] = ''; $config['proxy_password'] = ''; what is a service I can use that has a proxyaddress : port, username,password where I can run this php script from the same ip address (localhost for...

If you have link1 that redirects to link2, but you need to get link2, this is the code function get_link2($link1) { $ch = curl_init($link1); curl_setopt($ch, CURLOPT_HEADER, true); curl_setopt($ch, CURLOPT_NOBODY, true); curl_setopt($ch, CURLOPT_RETURNTRANSFER, true); $response =...

I'm hooked up with rotating proxies but my server domain and main ip are still showing. I don't have a clue about php or any other language but I really need to get my mailer up. I'm told I need to switch the url from http to https and install or activate php curl script. If anybody can help...

Hey Everyone, I get alot of info from these forums and I finally have something to contribute. I've done alot of cURL scraping in my time and have never understood how to use or properlly implement cURL Multi Handle. And now that I do, I wont ever go back. So if you use cURL regularly to do...