MuckMuffin
Newbie
- Sep 9, 2026
- 2
- 1
I need to locate an "invite-only" chat/discussion group out there. I need a site spyder of some type that searches sites by keywords or other parameters rather than by metadata. Any ideas from the pros?
Need advice on tools to find a totally unspydered site.
- Thread starter MuckMuffin
- Start date
dijitabraham
Newbie
- Jul 31, 2026
- 13
- 3
If you’re looking for small communities, then don’t use just the SEO databases. Search engines with specific niche footprints, as well as Common Crawl, can uncover websites that do not rank well in general SEO databases.
MuckMuffin
Newbie
- Sep 9, 2026
- 2
- 1
I know the subject, several names that are mentioned, a phone number that was given in the discussion, but that's about it. I also know the approximate physical location of most of the members. This is a small group of members, almost certainly between 40 and 60 members.
- Aug 9, 2017
- 5,682
- 6,995
Your only recourse is to search for combinations of those fragments of information you have in as many search indexes as you can. Google, Bing, Yandex, Yep, smaller foreign market search engines, PublicWWW etc. You're only going to be able to find information that has been spidered, there isn't a way to find the info you want unless an indexing service has seen it already.
StackOverlordd
Newbie
- Jun 29, 2026
- 30
- 6
with all that information, I would recommend trying the exact phrase search with subject + name/phone number as well as exploring common crawl nd some niche search engines. the problem is that if it is an invitation-only website, no spider would work magic for it.
DigitalVertex Agency
Registered Member
- Jul 28, 2026
- 81
- 9
hard to find true unspidered stuff these days most people just see google with advanced operators or check old directories
dijitabraham
Newbie
- Jul 31, 2026
- 13
- 3
Yeah, of course, the obvious footprints will be cleared off pretty quickly, but there may still be some nice finds from niche directories, expired domains, and other lesser known sources.
ezpzdoordie
Newbie
- Dec 27, 2022
- 8
- 1
maybe try a search engine with good full text indexing and use exact phrases from the topic that can uncover pages that don't have much useful metadata
cyberd0n666
Newbie
- Apr 30, 2023
- 7
- 0
you could test independent indexes like cl0q or purili for obscure public pages they search their own indexes rather than just relying on one search provider