Only for Screaming Frog gurus/experts

MrValdemar

MrValdemar

Junior Member
Joined
Oct 7, 2013
Messages
129
Reaction score
18
Hi

Id like to search for all pages of a website containing a particular word (the equivalent of Google's "word site:www.helloworld.com") but using screaming frog AND searching only for that word in the articles themselves, because that word is also present in the main menu, which means a general search would return every page.

I know I can do that with google, but screaming frog gives me a few extra possibilities, but I don't know how to work the parameters of the custom search and extraction tool.
 
Advertise on BHW
Why not just use python and the beautiful soup library? There are countless tutorials on the web how to do just what you are looking for. Just my two cents worth.
 
no idea what you just said, I'm completely unfamiliar with almost every word in your first sentence. Seems a bit daunting, perhaps sometime I'll check it out, right now I'm short on time to learn something that seems a bit complicated, but thanks for your response

For the time being though, I have experience using screaming frog so Id like to use it in the way I described in my OP, but theres no support forum for screaming frog that I could find so I'm hoping someone with experience and more knowledge will help me
 
wow, thats really helpful, how I didnt think about it?

obviously I googled and youtubed it, but I didnt quite find this same scenario I'm in, thats why I came here hoping that someone could help me, but going by the only two replies I got I guess this one is on me.

So yes, back to the drawing board, I'll find some other way to do it, or ask it somewhere else
 
MrValdemar said:
wow, thats really helpful, how I didnt think about it?

obviously I googled and youtubed it, but I didnt quite find this same scenario I'm in, thats why I came here hoping that someone could help me, but going by the only two replies I got I guess this one is on me.

So yes, back to the drawing board, I'll find some other way to do it, or ask it somewhere else
Click to expand...

MrValdemar said:
Id like to search for all pages of a website containing a particular word (the equivalent of Google's "word site:www.helloworld.com")
Click to expand...


http://lmgtfy.com/?q=screaming+frog+extract+page+containing+word

--> https://www.rubenvezzoli.online/find-pages-containing-specific-text-screaming-frog/

Don't tell me you really googled it. It took me 30 second
 
thanks but I already knew that because... well I googled it

the issue here, as I said in the OP, is that I have that word in my main menu, so screaming frog returns every single page of my website as a result.

there must be a way to filter, or for screaming frog to only look in the text of the articles for instances of the word, thats what I want, but it requires of parameters and operators I'm not really familiar with, thats why it isnt as easy as it sounds if you dont read carefully my OP, or perhaps I wasnt clear enough, in which case I apologize
 
You can actually exctract from the HTML. Just exctract the class of your menu+ word. Should work.
 
I dont know how to do that, thats why I came here to ask, we're going in circles

I cannot exclude results with the html of the menu option otherwise I wouldnt get any results.

I know perfectly well I need to filter out the menu option to make a search, but I dont know how, plus its not just the menu option, I need to exclude the related posts too.

Basically I need for screaming frog to only search within the articles.

If I could get a helpful answer that'd be great, thanks
 
giphy.gif
 
Advertise on BHW
You must log in or register to reply here.
Sign up now!

Main Menu

Home Main Forum List Black Hat SEO White Hat SEO BHW Newbie Guide Blogging Black Hat Tools Social Media Downloads

Marketplace

Account Selling Content / Copywriting EBooks / Methods Hosting Misc Proxies For Sale SEO - Link building SEO - Packages Social Media Social Media - Panels Web Design More

Making Money

Affiliate Programs Hire a Freelancer IM Journeys Making Money Pay Per Click Site Flipping Want to Buy

BlackHat World

Dispute Resolution Forum Suggestions & Feedback Introductions Lounge
Back
Top