[GET] Search Engine Scraper V0.2 - Now with a PageRank checker!

C

christoss1959

Senior Member
Joined
Nov 25, 2010
Messages
896
Reaction score
1,176
Hey guys this is the new version of My Search Engine Scraper (supports Google both .com and local versions, Yahoo and Bing). New in this version are the PageRank checker and the remove duplicate scraped results option. Enjoy!

How to use:
Scraper:
  • Copy or import list of keywords
  • Select search engine to use
  • Set custom footprint if you want
  • Set proxies through the proxies tab (Strongly suggested to avoid IP bans)
  • Click ?Start Scraping? (button changes to ?Stop Scraping? which can be used to stop the scraper)
  • Click the ?Remove Duplicates? button to remove scraper results that occured more than once
  • When the scraper is finished the nutton ?Stop Scraping? will be reverter back to ?Start Scraping? then you can copy the scraped urls or click save to save them to a text file

PR checker:

  • Copy or import list of websites you want to check their pagerank
  • Set proxies through the proxies tab (Strongly suggested to avoid IP bans. Not working proxies will results in a -1 PR of the site)
  • Set the minimum and maximum waiting between PageRank requests (this is a random waiting time to emulate human behavior)
  • Click Start PR check (The PR checker can be stopped by clicking the Stop PR check button<)/li>
  • Sites can be sorted by URL or PR (both ascendind and descending order) by clicking on either ther URL or PR header
  • The list of the websites with their pagerank can be saved as a CSV or a text file by clicking Save list

Download:
Code: 
http://www.mediafire.com/?prhpock3ufqqk7e

Virustotal (0/42):
Code: 
http://www.virustotal.com/file-scan/report.html?id=dd58cb561e37838553a907062cf954778926449dd53e81d775622d7806653d99-1321485527
 
Advertise on BHW
PLEASE make it able to scrape 1000 results per keyword!
 
@Banel I am doing this in my spare time, I have other programs that people have paid for that get my attention first. Also you are the only person who asked for this feature so other more important features get prioratized. If more people want this I will see what I can do. I personally find it useless to scrap 1000 results per keyword since you would get rubbish results.
 
I'll try this out, it does google.co.uk though right?
 
wannabie said:
I'll try this out, it does google.co.uk though right?
Click to expand...
Yes, it does google.co.uk.
I forgot to mention this but if anyone needs a local version of Google to be added it only takes a few seconds for me to add but because I couldn't find an official list for them I only included the ones I thought were important.
 
Can we use it to scrape email addresses from the search engines?
 
Maja92 said:
Can we use it to scrape email addresses from the search engines?
Click to expand...
No it can't but I've written another program you can use (also free):
Code: 
http://www.blackhatworld.com/blackhat-seo/member-downloads/373719-get-email-scraper-wizard-v0-5-a.html
 
You do know this won't work ? It will work a few times then it will hit a wall ?
Ever tried rank checker ? a capture image comes up on google search engine after you do so many searches.
I tryied to make my own search engine up and made a bot which would crawl google and store all the links even the potions of each link per a keyword. after 100 results it hit the wall cus of the capture image and its no good use capture image solving because can you imagine how many results google has and how many keywords ? A lot of money and capure solving LOL
 
shadow1200 said:
You do know this won't work ? It will work a few times then it will hit a wall ?
Ever tried rank checker ? a capture image comes up on google search engine after you do so many searches.
I tryied to make my own search engine up and made a bot which would crawl google and store all the links even the potions of each link per a keyword. after 100 results it hit the wall cus of the capture image and its no good use capture image solving because can you imagine how many results google has and how many keywords ? A lot of money and capure solving LOL
Click to expand...
Actually it does work I've used this method for quite some time now. You just need to use proxies. Even without proxies since the program is emulating human behavior so you may get away with using it (but I wouldn't suggest it).
 
Hey guys sorry but I am not sure I am going to be able to maintain (provide new features) to the Search Engine Scraper or any other of my bottopia software as I am starting off a new job tomorrow. In fact I am considering selling bottopia with all its software (with their source code) so that someone with the technical know how can use/improve them and they do not go to waste.

Just wanted to let you know,
Christos
 
christoss1959 said:
Hey guys this is the new version of My Search Engine Scraper (supports Google both .com and local versions, Yahoo and Bing). New in this version are the PageRank checker and the remove duplicate scraped results option. Enjoy!

How to use:
Scraper:
  • Copy or import list of keywords
  • Select search engine to use
  • Set custom footprint if you want
  • Set proxies through the proxies tab (Strongly suggested to avoid IP bans)
  • Click ?Start Scraping? (button changes to ?Stop Scraping? which can be used to stop the scraper)
  • Click the ?Remove Duplicates? button to remove scraper results that occured more than once
  • When the scraper is finished the nutton ?Stop Scraping? will be reverter back to ?Start Scraping? then you can copy the scraped urls or click save to save them to a text file

PR checker:

  • Copy or import list of websites you want to check their pagerank
  • Set proxies through the proxies tab (Strongly suggested to avoid IP bans. Not working proxies will results in a -1 PR of the site)
  • Set the minimum and maximum waiting between PageRank requests (this is a random waiting time to emulate human behavior)
  • Click Start PR check (The PR checker can be stopped by clicking the Stop PR check button<)/li>
  • Sites can be sorted by URL or PR (both ascendind and descending order) by clicking on either ther URL or PR header
  • The list of the websites with their pagerank can be saved as a CSV or a text file by clicking Save list

Download:
Code: 
http://www.mediafire.com/?prhpock3ufqqk7e

Virustotal (0/42):
Code: 
http://www.virustotal.com/file-scan/report.html?id=dd58cb561e37838553a907062cf954778926449dd53e81d775622d7806653d99-1321485527
Click to expand...

thanks, but it was useful to check on PR for list of sites
 
Hi.
This is crushing on all my compputers... any ideas?

Code: 
See the end of this message for details on invoking 
just-in-time (JIT) debugging instead of this dialog box.

************** Exception Text **************
System.Net.WebException: The remote server returned an error: (503) Server Unavailable.
   at System.Net.HttpWebRequest.GetResponse()
   at WindowsApplication1.frmmain.GoogleSearchAdvanced(Object whattosearchfor)
   at WindowsApplication1.frmmain.(Object , EventArgs )
   at System.Windows.Forms.Control.OnClick(EventArgs e)
   at System.Windows.Forms.Button.OnClick(EventArgs e)
   at System.Windows.Forms.Button.OnMouseUp(MouseEventArgs mevent)
   at System.Windows.Forms.Control.WmMouseUp(Message& m, MouseButtons button, Int32 clicks)
   at System.Windows.Forms.Control.WndProc(Message& m)
   at System.Windows.Forms.ButtonBase.WndProc(Message& m)
   at System.Windows.Forms.Button.WndProc(Message& m)
   at System.Windows.Forms.Control.ControlNativeWindow.OnMessage(Message& m)
   at System.Windows.Forms.Control.ControlNativeWindow.WndProc(Message& m)
   at System.Windows.Forms.NativeWindow.Callback(IntPtr hWnd, Int32 msg, IntPtr wparam, IntPtr lparam)
 
Last edited:
yoyo33 said:
Hi.
This is crushing on all my compputers... any ideas?

Code: 
See the end of this message for details on invoking 
just-in-time (JIT) debugging instead of this dialog box.

************** Exception Text **************
System.Net.WebException: The remote server returned an error: (503) Server Unavailable.
   at System.Net.HttpWebRequest.GetResponse()
   at WindowsApplication1.frmmain.GoogleSearchAdvanced(Object whattosearchfor)
   at WindowsApplication1.frmmain.(Object , EventArgs )
   at System.Windows.Forms.Control.OnClick(EventArgs e)
   at System.Windows.Forms.Button.OnClick(EventArgs e)
   at System.Windows.Forms.Button.OnMouseUp(MouseEventArgs mevent)
   at System.Windows.Forms.Control.WmMouseUp(Message& m, MouseButtons button, Int32 clicks)
   at System.Windows.Forms.Control.WndProc(Message& m)
   at System.Windows.Forms.ButtonBase.WndProc(Message& m)
   at System.Windows.Forms.Button.WndProc(Message& m)
   at System.Windows.Forms.Control.ControlNativeWindow.OnMessage(Message& m)
   at System.Windows.Forms.Control.ControlNativeWindow.WndProc(Message& m)
   at System.Windows.Forms.NativeWindow.Callback(IntPtr hWnd, Int32 msg, IntPtr wparam, IntPtr lparam)
Click to expand...
Sorry for my late reply it seems like your firewall is blocking the application to access the web. I would usually ask you to give more info but because I am selling the site with all its programs in flippa (listing actually finishes in a few hours) I don't plan to try to correct this error maybe the new owner will do so.
 
Hey,
First of all thank you!
this is a great tool!

could you please add Danish google as well? Google.dk
Thanks and Rep is given.

br
 
Advertise on BHW
You must log in or register to reply here.
Sign up now!

Main Menu

Home Main Forum List Black Hat SEO White Hat SEO BHW Newbie Guide Blogging Black Hat Tools Social Media Downloads

Marketplace

Account Selling Content / Copywriting EBooks / Methods Hosting Misc Proxies For Sale SEO - Link building SEO - Packages Social Media Social Media - Panels Web Design More

Making Money

Affiliate Programs Hire a Freelancer IM Journeys Making Money Pay Per Click Site Flipping Want to Buy

BlackHat World

Dispute Resolution Forum Suggestions & Feedback Introductions Lounge
Back
Top