A very simple tool I've developed to scrap websites blogs. The modules verify (if they have forms and are legit blogs) and post are yet not available in this GUI, so don't try using those. There are many good free tools that do those here, like TheLittlePortativeCommenter.
You can insert a keyword for the search (I have tested some UTF-8 characters to see if they actually worked, and it seems they do work, report it if it's not the case).
And the proxy list should be shaped like this:
and in case of user and password =>
The stop button can take some time to stop - if the proxies are slow and there are many threads.
To retrieve the list, right click anywhere in the list and click on Save websites.
I recommend using proxies (even public ones) for scraping, since Google can ban the IP temporarily if it seems too many requests from the same place in little time.
Being this one of the first Windows GUI's I've done, I would like to know if this actually works fine on other people.
Hope you can give it an use. Will at least try to finish the tool sometime.
You can insert a keyword for the search (I have tested some UTF-8 characters to see if they actually worked, and it seems they do work, report it if it's not the case).
And the proxy list should be shaped like this:
Code:
IP:PROXY
Code:
IP:PROXY:USER:PASSWORDTo retrieve the list, right click anywhere in the list and click on Save websites.
I recommend using proxies (even public ones) for scraping, since Google can ban the IP temporarily if it seems too many requests from the same place in little time.
Code:
Download Link:
mediafire.xxx/download.php?dmfo61dccjcyccm
VIRUSTOTAL:
hxxp://xxx.virustotal.xxx/file-scan/report.html?id=54e659e411c8977efe27162612a501cc8e551bf4ebcaf227744aa5fabd77714e-1313126146
Result:0/ 43 (0.0%)Hope you can give it an use. Will at least try to finish the tool sometime.
