1. This website uses cookies to improve service and provide a tailored user experience. By using this site, you agree to this use. See our Cookie Policy.
    Dismiss Notice

Curl Content Theft

Discussion in 'Black Hat SEO' started by turquaze, Mar 27, 2019.

  1. turquaze

    turquaze Newbie

    Joined:
    Mar 27, 2019
    Messages:
    4
    Likes Received:
    0
    Gender:
    Male
    My Internet site opens and indexes in a different domain. I think Those who are using curl, because when I block access to my site IP addresses, the thief gives error about the field name curl.

    However, at certain intervals the same thing is done with different IP addresses

    On my Own site;

    I'm using Wordpress Panel VESTACP

    Real site:

    bit-ly/2SdqnC7

    Thief site:

    bit-ly/2JK0pXv

    "-" instead "." please.

    As an Example I can give the following site the same situation same person does me

    What can I do to prevent it?
     
    Last edited: Mar 27, 2019
  2. IMons

    IMons Junior Member

    Joined:
    Apr 24, 2014
    Messages:
    101
    Likes Received:
    19
    use cloudflare or something similar, it'll help with "bot" traffic
     
  3. Gogol

    Gogol Jr. VIP Jr. VIP

    Joined:
    Sep 10, 2010
    Messages:
    5,965
    Likes Received:
    5,879
    Gender:
    Male
    Occupation:
    Programmer
    Location:
    Pale Blue Dot
    Home Page:
    Did you mean that someone is copying your content to another site?
    To be frank, it is pretty tough to block an advanced bot. For basic bots, try cloudflare like the poster above suggested. For more advanced bots, you need to fingerprint the bot with things like... IP, user agent, OS, if JS is enabled, if bot mode is on (selenium bots usually push a js variable (google it, can't remember the name right now. I am on mobile)), window size, initial cursor position and so on. Yet, some bots will escape that mechanism...
     
  4. stromind

    stromind Jr. VIP Jr. VIP

    Joined:
    Oct 1, 2018
    Messages:
    361
    Likes Received:
    85
    Gender:
    Male
    Occupation:
    system administrator
    Location:
    localhost
    Home Page:
  5. turquaze

    turquaze Newbie

    Joined:
    Mar 27, 2019
    Messages:
    4
    Likes Received:
    0
    Gender:
    Male
    I understand, cloudflare about i will do research.

    Nginx only one domain works possible? different url connection block, so image, javascript, etc
     
  6. turquaze

    turquaze Newbie

    Joined:
    Mar 27, 2019
    Messages:
    4
    Likes Received:
    0
    Gender:
    Male
    but i use headers


    X-Frame-Options SAMEORIGIN
    X-Content-Type-Options nosniff
    X-Xss-Protection 1; mode=block
     
  7. Gogol

    Gogol Jr. VIP Jr. VIP

    Joined:
    Sep 10, 2010
    Messages:
    5,965
    Likes Received:
    5,879
    Gender:
    Male
    Occupation:
    Programmer
    Location:
    Pale Blue Dot
    Home Page:
    That would totally kill any potential on site seo scope (if you mean ..the site owner will load the content via iframe for blocking bots).. Same goes for loading content via ajax.
     
    • Thanks Thanks x 1
  8. turquaze

    turquaze Newbie

    Joined:
    Mar 27, 2019
    Messages:
    4
    Likes Received:
    0
    Gender:
    Male
    Definitely affecting seo, also Google indexed thief site