404 for page that exists

Junoseo

Newbie
Joined
Oct 22, 2016
Messages
15
Reaction score
0
Hey guys,

I crawled a website and some urls resulted as 404.
However when I checked on of the url it appeared on my browser however the http disappear from the url so it seems like a redirect.

But I don't get why there is a 404 response when I crawl the website.
 
Any page from a webserver can also return any response code... Typically a default error page shows for most error responses but you can configure the server to return any URL you want for an error response. When people do this for 404 errors they are referred to as Soft 404s because they return an error response but still serve a valid page that tries to convert.
 
I understand that soft404 are url with a 200 response and the server return the page with an error response. The contrary is happening with the website:the crawl shows a 404 response but the url appear on my browser, I can see the page which should not be the case if it was 404. Isn't it?
 
Back
Top