thekingmaker
Power Member
- Jan 15, 2013
- 513
- 332
Well as i said in my thread earlier, i am posting my scraper i created here.I have learnt a lot of helpful things from from bhw, Hope this would be helpful to atleast a few.
You will need:
So first, you need to install foxyproxy in chrome.Then add a working proxy to it.
After adding a proxy, Enable the proxy.[This is optional]
So first, you have to Goto ->https://www.google.com/preferences And Click the Checkbox "Never Show Instant results.Then change the results per page to 100
Now next step is to scrape the type of links required by you from google.Here is a list of footprints to search in google for the type of links you may need
Now enable seoquake if it is disabled.So lets come to the scraping part for example if i need to scrape some wiki links, i will search google with footprints like"This page was last modified on "wiki" " Now after entering the footprint, click search.Now arrange the pages according to pagerank.
Now click Edit macro in the current.iim and paste the following code.
Now Set the Max loops to 105 and Click Play Loop, Now all the links will be saved To
D:\scrapedlinks.CSV If you want you can change the location and name in the code.
Well thats it you can improve the imacros by changing the code according to your requirements.
If you dont have proxy, You can try this.Only check the pagerank in google.This way my ip didn't get banned by google.But you will be on the safer side if you use a proxy.
If you have any questions or if it does not work for you please post here.
Note:If this is not working for you try this:
You will need:
So first, you need to install foxyproxy in chrome.Then add a working proxy to it.
After adding a proxy, Enable the proxy.[This is optional]
So first, you have to Goto ->https://www.google.com/preferences And Click the Checkbox "Never Show Instant results.Then change the results per page to 100
Now next step is to scrape the type of links required by you from google.Here is a list of footprints to search in google for the type of links you may need
Code:
http://www.blackhatworld.com/blackhat-seo/black-hat-seo/491042-get-huge-search-engine-optimization-footprints-collections.htmlNow enable seoquake if it is disabled.So lets come to the scraping part for example if i need to scrape some wiki links, i will search google with footprints like"This page was last modified on "wiki" " Now after entering the footprint, click search.Now arrange the pages according to pagerank.
Now click Edit macro in the current.iim and paste the following code.
Code:
VERSION BUILD=6700624 RECORDER=FXSET !EXTRACT_TEST_POPUP NO
TAB T=1
TAG XPATH="//li[{{!LOOP}}]/div/h3/a" EXTRACT=HREF
SAVEAS TYPE=EXTRACT FOLDER=D:\ FILE=scrapedlinks.CSVNow Set the Max loops to 105 and Click Play Loop, Now all the links will be saved To
D:\scrapedlinks.CSV If you want you can change the location and name in the code.
Well thats it you can improve the imacros by changing the code according to your requirements.
If you dont have proxy, You can try this.Only check the pagerank in google.This way my ip didn't get banned by google.But you will be on the safer side if you use a proxy.
If you have any questions or if it does not work for you please post here.
Note:If this is not working for you try this:
Code:
[URL]http://www.blackhatworld.com/blackhat-seo/black-hat-seo/575528-method-fast-easy-way-scraping-high-google-page-ranking-links-google.html[/URL]
