Hey guys,
I crawled a website and some urls resulted as 404.
However when I checked on of the url it appeared on my browser however the http disappear from the url so it seems like a redirect.
But I don't get why there is a 404 response when I crawl the website.
I crawled a website and some urls resulted as 404.
However when I checked on of the url it appeared on my browser however the http disappear from the url so it seems like a redirect.
But I don't get why there is a 404 response when I crawl the website.