Need advice on tools to find a totally unspydered site.

MuckMuffin

Newbie
Joined
Sep 9, 2026
Messages
2
Reaction score
1
I need to locate an "invite-only" chat/discussion group out there. I need a site spyder of some type that searches sites by keywords or other parameters rather than by metadata. Any ideas from the pros?
 
Any site you want to find via keywords will have to be spidered/indexed by some bot or app. Do you know anything at all about this discussion site you're looking for? Any possible text fragment on there?
 
If you’re looking for small communities, then don’t use just the SEO databases. Search engines with specific niche footprints, as well as Common Crawl, can uncover websites that do not rank well in general SEO databases.
 
Any site you want to find via keywords will have to be spidered/indexed by some bot or app. Do you know anything at all about this discussion site you're looking for? Any possible text fragment on there?
I know the subject, several names that are mentioned, a phone number that was given in the discussion, but that's about it. I also know the approximate physical location of most of the members. This is a small group of members, almost certainly between 40 and 60 members.
 
Your only recourse is to search for combinations of those fragments of information you have in as many search indexes as you can. Google, Bing, Yandex, Yep, smaller foreign market search engines, PublicWWW etc. You're only going to be able to find information that has been spidered, there isn't a way to find the info you want unless an indexing service has seen it already.
 
I need to locate an "invite-only" chat/discussion group out there. I need a site spyder of some type that searches sites by keywords or other parameters rather than by metadata. Any ideas from the pros?
with all that information, I would recommend trying the exact phrase search with subject + name/phone number as well as exploring common crawl nd some niche search engines. the problem is that if it is an invitation-only website, no spider would work magic for it.
 
I need to locate an "invite-only" chat/discussion group out there. I need a site spyder of some type that searches sites by keywords or other parameters rather than by metadata. Any ideas from the pros?
that’s the case with any public index. after you go from being invite-only and/or login-only, nd have not yet been indexed anywhere else, there is nothing that can search inside it.
 
Back
Top