[GET][SCRIPT] Google Suggest Keyword Scraper

FisnikS said:

Do the suggestions change depending on the IP (location) of the search?

Click to expand...

buzzcore said:

I'm not sure to be honest. However you can modify it for any language you want by changing the "hl=en" to hl={required 639-1 language code} http://en.wikipedia.org/wiki/List_of_ISO_639-1_codes.

Click to expand...

knopper said:

Why don't you add proxy support to this script?

Click to expand...

TZ2011 said:

Some formatting issues (copy/paste code to forum) giving error in line 14. Try this

Code:

<?php
if (isset($_POST["keyword"]) && $_POST['keyword'] !== "") {
$alphas1 = range('A', 'Z');
$alphas2 = range('A', 'Z');
$keyword = $_POST['keyword'];
foreach ($alphas1 as $a1) { foreach ($alphas2 as $a2) {
$xml = simplexml_load_file( utf8_encode("http://suggestqueries.google.com/complete/search?output=toolbar&hl=en&q=$keyword.' '.$a1.$a2"));
foreach ($xml->children() as $child) {
foreach ($child->suggestion->attributes() as $dta) {
echo "<br>";
echo $dta;
}}}}
} else {
?>
<form action="<?php $_SERVER['PHP_SELF'];?>" method="post">Keyword: <input type="text" name="keyword" required><input type="submit"></form>
<?php
}
?>

OP, you should check encoding, something with simplexml_load_file() is not ok, I have tried to push utf-8 with

$xml = simplexml_load_file( utf8_encode("http://suggestqueries.google.com/complete/search?output=toolbar&hl=en&q=$keyword.' '.$a1.$a2"));

but still getting some error after results are printed. I am away of my working laptop now so can not test it further but just wanted to let you know. this is error

Code:

[B]Warning[/B]:  simplexml_load_file() [[URL="http://popupdevil.com/function.simplexml-load-file"]function.simplexml-load-file[/URL]]:   [URL]http://suggestqueries.google.com/complete/search?output=toolbar&hl=en&q=story.'%20'.C.J:1:[/URL]  parser error : Input is not proper UTF-8, indicate encoding ! Bytes: 0x9A 0x61 0x76 0x61 in [B]/my domain here/GoogleSuggestKeywordScraper.php[/B] on line [B]7[/B]

[B]Warning[/B]:  simplexml_load_file() [[URL="http://popupdevil.com/function.simplexml-load-file"]function.simplexml-load-file[/URL]]: 7"/></CompleteSuggestion><CompleteSuggestion><suggestion data="story cjenik ogla in [B][B]/my domain here[/B]/GoogleSuggestKeywordScraper.php[/B] on line [B]7[/B]

[B]Warning[/B]:  simplexml_load_file() [[URL="http://popupdevil.com/function.simplexml-load-file"]function.simplexml-load-file[/URL]]:                                                                                ^ in [B]/my domain here/[/B][B]GoogleSuggestKeywordScraper.php[/B] on line [B]7[/B]

[B]Fatal error[/B]:  Call to a member function children() on a non-object in [B][B]/my domain here/[/B]GoogleSuggestKeywordScraper.php[/B] on line [B]8[/B]

Click to expand...

Oguzz14 said:

I wanted to post the job here as well:

Hi,

buzzcore, has made a great "google suggestions scraper" here: "search the forum for:"[GET][SCRIPT] Google Suggest Keyword Scraper"


Thanks a lot again for what he has done and for sharing it here publicly. The code is shared in the post, too.

What I need is: the shared script works for scraping suggestions in the "keyword + anyword" format, I mean it scrapes the search suggestions that are added afterthe entered keyword.

I need a small change in the script and a small selection feature like "before keyword" or "after keyword" so that the script can do the same job for scraping suggestions in the "anyword + keyword" format. So it basically needs words creation engine before the keyword, as well. And the words can be more than 1.

I need to do that because I want to scrape "..... .... treatment" keywords from google. Such keywords like:

"asthma treatment"
...
...
"herpes treatment"
"hemorrhoids treatment"
...
"knee pain treatment"
...
...
"stress treatment"
...
etc..

I'll pay $20 for it. And I'll share it here in the bhw just like buzzcore so that everyone can benefit it.

buzzcore himself is also welcomed to make the changes since it's his script he can do it faster than anybody I guess.

The freelancer should make a scrape after the job and prove that it works.

Please feel free to ask any questions if you don't understand anything.

Thanks for reading.

Click to expand...