Free Sitemap Scraper for BHW

S

slipchamber

Registered Member

Jun 25, 2010

93

16

• Dec 4, 2010

• #1

a little tool I made that people were using and I didn't even know, until I took it down and they complained..

<?php

echo "Example Input: http://www.stockblogs.com/sitemap.xml<br><br>";

$search2 = $_POST['search'];

if(isset($_POST['search'])){
$search = urlencode($search2);
$string = file_get_contents("$search2");
preg_match_all('~<loc>(.*)</loc>~isU', $string, $goog);
$count = "0";
do{
$googcount = $goog[1][$count];
echo $googcount."<br>";
$count = $count + 1;}
while ($googcount != '');

echo "<br>";
}
echo "A simple tool to find all links on an XML or AXD sitemap";
echo "<br>";
echo "<br>";
echo "<form action=\"magicscrape.php\" target=\"_self\" method=\"post\">";
echo "<input type=\"text\" id =\"search\" name=\"search\" type=\"text\" size=\"25\" maxlength=\"50\" >"."</input>";
echo "<script>"."document.getElementById('search').focus()"."</script>";
echo "<br>";
echo "<br>";
echo "<input type=\"submit\" value=\"Find Links\">";
echo "</form>"
?>

 

M

moonpromo

Newbie

Aug 26, 2010

34

13

• Mar 26, 2011

• #2

You should point that file need to be named magicscrape.php in order this script to work

 

carlito

BANNED

Aug 22, 2010

1,152

328

• Mar 27, 2011

• #3

It would be cool to have a script that scrapes all the urls of a site which doesnt have any sitemap.xml (there are tons)

anyway thanks for sharing