What scraper should I build?

N

NG-neer

Newbie

Jun 27, 2018

31

8

• Oct 28, 2018

• #1

Hey,

I want to build a scraper with selenium. Does anyone have an idea or some wishes?

 

bartosimpsonio

Elite Member

Executive VIP

Jr. VIP

Mar 21, 2013

24,764

31,552

• Oct 28, 2018

• #2

Instagram scraping seems to be hot at the moment.

 

N

NG-neer

Newbie

Jun 27, 2018

31

8

• Oct 28, 2018
• Thread Starter Thread Starter

• #3

Funny. I actually just opened two thrrads about that. I coincidentally also have written an unofficial instagram API so I could definitely do that. Do you have any more info on what I could scrape?

 

matthewplp

Registered Member

Jun 25, 2012

53

16

• Oct 28, 2018

• #4

What are you scraping on instagram and how is it useful?

 

Elegante

Regular Member

Jul 6, 2015

429

153

• Oct 28, 2018

• #5

A Reddit scraper for images would be so useful.

 

R

red333

BANNED

Aug 18, 2018

295

53

• Oct 28, 2018

• #6

WhatsAppWeb scraper.
Scrapes numbers from all groups you in

 

SEOtime

Regular Member

Apr 18, 2013

296

178

• Oct 30, 2018

• #7

A discord scraper would be nice

 

do do

Registered Member

Oct 31, 2018

61

11

• Oct 31, 2018

• #8

As far as I know, Google hates scraped content and does not allow ads running on them. So, what is your businesses model/plan for monetizing tools/web sites based on scraping?

 

jimbobo2779

Elite Member

Jr. VIP

Sep 17, 2008

6,037

3,973

• Oct 31, 2018

• #9

do do said:

As far as I know, Google hates scraped content and does not allow ads running on them. So, what is your businesses model/plan for monetizing tools/web sites based on scraping?

Click to expand...

That may be a bit short sighted mate. For starters if you are scraping content that is not currently indexable then Google has no idea it is scraped. Secondly there are many more options to monetise other than Google.

 

wrathofend

Regular Member

Sep 11, 2018

380

46

• Oct 31, 2018

• #10

scrape for high engagemenet instagram posts.

 

do do

Registered Member

Oct 31, 2018

61

11

• Oct 31, 2018

• #11

jimbobo2779 said:

there are many more options to monetise other than Google.

Click to expand...

And that's what i'm more curious about

 

J

john500dipika

BANNED

Oct 16, 2018

54

16

• Oct 31, 2018

• #12

email scraper from FB groups!!

 

L

lawrencelau

Supreme Member

Mar 29, 2008

1,310

576

• Nov 1, 2018

• #13

scrape "People Who like [page name]" in facebook

 

M

MrFlop

Registered Member

Sep 8, 2017

55

15

• Nov 1, 2018

• #14

Scrape usernames of followers via Instagram would be good!

 

D

DirtySoftTaco

Newbie

Nov 15, 2018

3

0

• Nov 15, 2018

• #15

NG-neer said:

Hey,

I want to build a scraper with selenium. Does anyone have an idea or some wishes?

Click to expand...

I have a working scraper that take craigslist motorcycle listings and puts them in a database for later comparison ie. which month of the year is best to buy a specific bike, what's the lowest this bike went for this year, what is a good deal or not. I'm planning on expanding to other parts of craigslist.