Let's take domain.com as an example, if I google "site:domain.com" all pages such as domain.com/about.html, domain.com/example/whats-up.html, etc. would appear as search results. If I only want results such as domain.com/xxxx and keep deeper urls like domain.com/xxxx/xxxx.html out, what parameters should I use?
Thanks
P.S.: I'm trying to scrape indexed pages of a site to a certain level (to domain.com/xxxx in this case).
Thanks
P.S.: I'm trying to scrape indexed pages of a site to a certain level (to domain.com/xxxx in this case).
Last edited: