[HELP] I Want Ask For Robots.txt Please Answer Me !

Naga Hoki

Newbie

Jan 7, 2019

8

1

• Jan 28, 2019

• #1

internet-positif.org
Does anyone know what website this robot uses? and what robot name?
I really want the crawler not to crawl my website. because these crawlers block many websites in Indonesia. please help me in this matter.

 

AirProxy

Junior Member

Jul 5, 2018

105

49

• Jan 28, 2019

• #2

Image is not visible @Naga Hoki

 

SoccerLover

Elite Member

Jun 12, 2014

5,007

2,773

• Jan 29, 2019

• #3

THREAD MOVED​