Anyway to find hidden pages of a website?

umerjutt00 said:

You got lots of things covered. Another idea will be to use less popular search engines. They don't really care much about robots.txt and noindex tags. Good luck.

Click to expand...

Breakfast1234 said:

Did you try screaming frog?

Click to expand...

Rafiki59 said:

you can try yoursite/sitemap.xml

Click to expand...

RayChand said:

Why don't you just create your own spider ?

Click to expand...

t2van said:

WP Content Discovery for Chrome, never used it but If I remember someone made that back in 2016/17 using some call to do with the wordpress API to pull all pages a text list I think

Click to expand...

itz_styx said:

to find really hidden urls that arent linked fo from any of the public pages, fuzzing is the only real solution, but it takes time.

Click to expand...

AuraMarketing said:

Hello BHW

I'm trying to find some hidden pages on a WordPress site. The pages are in this format...
https://wordpresssite.com/hiddenlink.php

What I've tried so far...
1. Checking Google, Yandex, Bing Index for that site using
site:wordpresssite.com
2. Checking the above search engines using the two terms I know are present on that page
"Term present on that page"
3. Checking the above search engines using the URL terms:
inurl:term used in URL
4. Using URL fuzzer from pentest-tools and cyber-hub
5. Using search function present on that site
6. By checking their WordPress plugins to know if they're using some common plugin through which I could guess the URL.
7. Using earthpage content discovery extension
8. Using netpeak checker
9. Randomly guessing the URL
10. Searching for images in Google using site:wordpresssite.com
11. Checked archive.org

Am I missing out something? Is there any way of getting the pages?

Click to expand...