Curl Content Theft

turquaze

Newbie

Mar 27, 2019

4

0

• Mar 27, 2019

• #1

My Internet site opens and indexes in a different domain. I think Those who are using curl, because when I block access to my site IP addresses, the thief gives error about the field name curl.

However, at certain intervals the same thing is done with different IP addresses

On my Own site;

I'm using Wordpress Panel VESTACP

Real site:

bit-ly/2SdqnC7

Thief site:

bit-ly/2JK0pXv

"-" instead "." please.

As an Example I can give the following site the same situation same person does me

What can I do to prevent it?

 

Last edited: Mar 27, 2019

I

IMons

Junior Member

Apr 24, 2014

104

20

• Mar 27, 2019

• #2

use cloudflare or something similar, it'll help with "bot" traffic

 

Gogol

Administrator

Staff member

Moderator

Executive VIP

Jr. VIP

Sep 10, 2010

11,805

26,657

• Mar 27, 2019

• #3

Did you mean that someone is copying your content to another site?
To be frank, it is pretty tough to block an advanced bot. For basic bots, try cloudflare like the poster above suggested. For more advanced bots, you need to fingerprint the bot with things like... IP, user agent, OS, if JS is enabled, if bot mode is on (selenium bots usually push a js variable (google it, can't remember the name right now. I am on mobile)), window size, initial cursor position and so on. Yet, some bots will escape that mechanism...

 

stromind

Senior Member

Jr. VIP

Oct 1, 2018

1,166

328

• Mar 27, 2019

• #4

it could be a simple iframe injection

 

turquaze

Newbie

Mar 27, 2019

4

0

• Mar 27, 2019
• Thread Starter Thread Starter

• #5

I understand, cloudflare about i will do research.

Nginx only one domain works possible? different url connection block, so image, javascript, etc

 

turquaze

Newbie

Mar 27, 2019

4

0

• Mar 27, 2019
• Thread Starter Thread Starter

• #6

stromind said:

it could be a simple iframe injection

Click to expand...

but i use headers


X-Frame-Options SAMEORIGIN
X-Content-Type-Options nosniff
X-Xss-Protection 1; mode=block

 

Gogol

Administrator

Staff member

Moderator

Executive VIP

Jr. VIP

Sep 10, 2010

11,805

26,657

• Mar 27, 2019

• #7

stromind said:

it could be a simple iframe injection

Click to expand...

That would totally kill any potential on site seo scope (if you mean ..the site owner will load the content via iframe for blocking bots).. Same goes for loading content via ajax.

 

turquaze

Newbie

Mar 27, 2019

4

0

• Mar 27, 2019
• Thread Starter Thread Starter

• #8

Gogol said:

That would totally kill any potential on site seo scope (if you mean ..the site owner will load the content via iframe for blocking bots).. Same goes for loading content via ajax.

Click to expand...

Definitely affecting seo, also Google indexed thief site