Ways to scrape subreddits based on keywords?

Shibbi90

Regular Member

Mar 3, 2011

484

236

• Jul 6, 2021

• #1

Is there any bot or method to scrape subreddits based on keywords? The search function on Reddit sucks when it comes to finding new subs.
Can I make google search only return results of different subs?

Would be nice to get members and members online stats for each sub, but not required.

 

iceapple

Junior Member

May 26, 2021

118

52

• Jul 6, 2021

• #2

You can use google dorks to scrape specific URLs and domains. For example, you can search the sub r/AskReddit for the keyword movies as:

Code:

"movies" inurl:r/AskReddit site:reddit.com

 

Shibbi90

Regular Member

Mar 3, 2011

484

236

• Jul 6, 2021
• Thread Starter Thread Starter

• #3

iceapple said:

You can use google dorks to scrape specific URLs and domains. For example, you can search the sub r/AskReddit for the keyword movies as:

Code:

"movies" inurl:r/AskReddit site:reddit.com

Click to expand...

Yeah, I know that but I dont know how to use it to find new subs. Im not looking to search inside a sub. Any suggestions?

 

iceapple

Junior Member

May 26, 2021

118

52

• Jul 6, 2021

• #4

Code:

"movies" site:reddit.com inurl:/comments/ intext:r/

A modified version, which searches the comments for subreddits, as new subreddits are most likely posted in comments for promotion.