Gscraper Question

can someone tell me why my gscraper is scraping a lot of urls with webcache.googleusercontent.com on the url and how i can get rid of that, thanks.

I wouldn't know why you would get such urls, but I guess you could use something like notepad++ to find and replace whatever text you wish to get rid of with nothing.

Thanks, i was trying that but the url looks like this:

Code:

http://webcache.googleusercontent.com/search?num=100&hl=en&prmdo=1&q=cache:u3I5OZRV0QwJ:(SCRAPED URL)+(FOOTPRINT)+(KEYWORD)

Click to expand...

numbers after =cache are all different and the keyword is also different so its complicated to clear the actual scraped url.

Nobody got solution on this?

Use notepad++ to get rid "webcache.googleusercontent.com" using regex.

I could show you the basic method that GScraper uses to filter URL's, but it would not solve your problem. So we will spoon feed you.

> Go to the filter tab



> Select URL include.
> In the textbox enter what you want to filter out (webcashe), you do not need the Googleusercontent . com, but you can include it if it makes you feel good.
> Go to the bottom of that groupbox next to "it cant post reply," and click do.
>Save list back to file.

This method will filter out what you do not want.

What footprint are you using for the scrape? And what JustUs posted will do the job but
it seems like it is something you're using as a footprint.