How to scrape Google Discussion results with SB?

kazhkaz

Supreme Member

Aug 19, 2010

1,238

374

• Nov 3, 2011

• #1

Hi guys!

Is there a footprint or any way to scrape Google Discussion results with Scrapebox/Scrapeboard? I would like to use it instead of searching for each forum platform individually.

 

GoldenGlovez

Senior Member

Mar 23, 2011

891

2,205

• Nov 3, 2011

• #2

If you're just looking to harvest the URLs in Google groups it's quite simple.

site:groups.google.com %KW%

That should find groups related to each keyword in your list.

 

kazhkaz

Supreme Member

Aug 19, 2010

1,238

374

• Nov 4, 2011
• Thread Starter Thread Starter

• #3

It is not what I am looking for. I want to scrape Google SERP with "Discussions" Filter which is on the left side. Example:

Code:

http://www.google.com/search?q=black+hat&ie=utf-8&oe=utf-8&aq=t&rls=org.mozilla:lt:official&client=firefox-a#q=black+hat&hl=en&client=firefox-a&hs=2ga&rls=org.mozilla:lt:official&prmd=imvnsfd&source=lnms&tbm=dsc&ei=HKCzTpj-L5HtsgaSv8zSAw&sa=X&oi=mode_link&ct=mode&cd=7&ved=0CCQQ_AUoBg&bav=on.2,or.r_gc.r_pw.,cf.osb&fp=b280ba999ac45444&biw=1440&bih=742

 

D

danny1

Regular Member

Oct 8, 2009

269

113

• Apr 29, 2012

• #4

^
Re-opening a thread from 5+ months ago, simply to inflate your post count.
If you want to post something that's gonna' be useful, try something more recent...

dcostso said:

There's really no way to do it legitimately without Google's permission.

Click to expand...

This is BHW, we don't need Google's permission to do jack.

You could scrape the serps using use an automation tool like Ubot. You don't have to use 100's of proxies, a handful of private proxies should be sufficient.

 

Last edited: Apr 29, 2012

G

GETHITS.YOU50

BANNED

Apr 10, 2012

115

25

• Apr 29, 2012

• #5

I'm sure there some footprint to easily do it

 

D

danny1

Regular Member

Oct 8, 2009

269

113

• Apr 29, 2012

• #6

u11dead said:

i have try scrapebox with 30 private proxies with 5s delay,8 connection.but sometime all proxies are banned by Google.you need about 100 proxies or above to run scrapebox 24/7.

Click to expand...

I can scrape 24/7 using 20 private proxies and around 4 connections. You need to reduce your connections and/or change your provider.

GETHITS.YOU50.COM said:

I'm sure there some footprint to easily do it

Click to expand...

Nope. There are no footprints to use with Scrapebox, because it does not search within those results.

 

D

donttazemebro

Newbie

Nov 13, 2011

16

1

• Apr 30, 2012

• #7

Ive really gotta get a copy of scrapebox. So useful!

 

C

Cheefdaily

Newbie

May 1, 2012

11

0

• May 1, 2012

• #8

To use scrapebox youll need an ethernet proxy