Scraping BHW - allowed or not?

Is it allowed to scrape blackhatworld search results?

I want to use blackhatworld data for research purposes to learn and create a database of knowledge cause there's too much info and chaos became deep.

Then I would publish that database publicly with collections.

Which means I have to ask because if I publish it without permission they'd ask "did he scrape without our permission?".

I would like to scrape "golden info" of some users, then put them into specific pages (not my sales pages, but public BHW as info available to everyone for free).

BHW is a good material for 100s pages long book.

When I was attacking BHW with F5 button or clicking logo violently, I'd get rate limited.

So I guess first step would be to scrape at moderate pace.

But I would do more threads with proxies. And then get caught...

Your so fckd now.

RoiBox said:

Your so fckd now.

Click to expand...

Keep it civil. It's forum suggestions subforum which means it has more formal character.

I haven't done any "scraping actions" so far, so nothing has happened.

Isn't that like walking into a bank, casually going behind the till while smiling at the staff, filling up a bag full of money and then tipping your hat to them as you walk out of the front door?

MrApple said:

Isn't that like walking into a bank, casually going behind the till while smiling at the staff, filling up a bag full of money and then tipping your hat to them as you walk out of the front door?

Click to expand...

No man.

I just was thinking of a program that does this:

1. Goes to profile like: https://www.blackhatworld.com/search/15614443/?c[users]=reaaski&o=date
2. Creates 10 links like this:
https://www.blackhatworld.com/search/15614443/?page=1&c[users]=reaaski&o=datehttps://www.blackhatworld.com/search/15614443/?page=2&c[users]=reaaski&o=datehttps://www.blackhatworld.com/search/15614443/?page=3&c[users]=reaaski&o=datehttps://www.blackhatworld.com/search/15614443/?page=4&c[users]=reaaski&o=datehttps://www.blackhatworld.com/search/15614443/?page=5&c[users]=reaaski&o=datehttps://www.blackhatworld.com/search/15614443/?page=6&c[users]=reaaski&o=datehttps://www.blackhatworld.com/search/15614443/?page=7&c[users]=reaaski&o=datehttps://www.blackhatworld.com/search/15614443/?page=8&c[users]=reaaski&o=datehttps://www.blackhatworld.com/search/15614443/?page=9&c[users]=reaaski&o=datehttps://www.blackhatworld.com/search/15614443/?page=10&c[users]=reaaski&o=date3. Goes to page=10, then clicks "View older results".
4. Repeats step 2 and 3 until all links are available.

The pseudo code is already done. All you need to do is ask for permission.

Wow
I don't think to scraping this website never
But I'm not agree with you in this way.

reaaski said:

Keep it civil. It's forum suggestions subforum which means it has more formal character.

Click to expand...

So you think it is civil to ask if you can scrape the forum. Ok.

reaaski said:

No man.

I just was thinking of a program that does this:

1. Goes to profile like: https://www.blackhatworld.com/search/15614443/?c[users]=reaaski&o=date
2. Creates 10 links like this:
https://www.blackhatworld.com/search/15614443/?page=1&c[users]=reaaski&o=datehttps://www.blackhatworld.com/search/15614443/?page=2&c[users]=reaaski&o=datehttps://www.blackhatworld.com/search/15614443/?page=3&c[users]=reaaski&o=datehttps://www.blackhatworld.com/search/15614443/?page=4&c[users]=reaaski&o=datehttps://www.blackhatworld.com/search/15614443/?page=5&c[users]=reaaski&o=datehttps://www.blackhatworld.com/search/15614443/?page=6&c[users]=reaaski&o=datehttps://www.blackhatworld.com/search/15614443/?page=7&c[users]=reaaski&o=datehttps://www.blackhatworld.com/search/15614443/?page=8&c[users]=reaaski&o=datehttps://www.blackhatworld.com/search/15614443/?page=9&c[users]=reaaski&o=datehttps://www.blackhatworld.com/search/15614443/?page=10&c[users]=reaaski&o=date3. Goes to page=10, then clicks "View older results".
4. Repeats step 2 and 3 until all links are available.

The pseudo code is already done. All you need to do is ask for permission.

Click to expand...

Sorry - miss read your intentions (can probably tell coding is not my forte)

Our answer would be no for so many obvious reasons.

If you have further questions please visit our newbie guide summary here https://www.blackhatworld.com/seo/s...ter-list-of-all-newbie-guide-threads.1389081/

If that doesn’t answer your question please reach out to support.blackhatworld.com for further guidance.

Answer supplied - thread closed.