Only for Screaming Frog gurus/experts

[MrValdemar]

Hi

Id like to search for all pages of a website containing a particular word (the equivalent of Google's "word site:www.helloworld.com") but using screaming frog AND searching only for that word in the articles themselves, because that word is also present in the main menu, which means a general search would return every page.

I know I can do that with google, but screaming frog gives me a few extra possibilities, but I don't know how to work the parameters of the custom search and extraction tool.

 

[appProgrammer]

Why not just use python and the beautiful soup library? There are countless tutorials on the web how to do just what you are looking for. Just my two cents worth.

 

[MrValdemar]

no idea what you just said, I'm completely unfamiliar with almost every word in your first sentence. Seems a bit daunting, perhaps sometime I'll check it out, right now I'm short on time to learn something that seems a bit complicated, but thanks for your response

For the time being though, I have experience using screaming frog so Id like to use it in the way I described in my OP, but theres no support forum for screaming frog that I could find so I'm hoping someone with experience and more knowledge will help me

 

[Elon Snup]

Just google it and watch some video tutorials about custom filters.

 

[MrValdemar]

wow, thats really helpful, how I didnt think about it?

obviously I googled and youtubed it, but I didnt quite find this same scenario I'm in, thats why I came here hoping that someone could help me, but going by the only two replies I got I guess this one is on me.

So yes, back to the drawing board, I'll find some other way to do it, or ask it somewhere else

 

[Elon Snup]

wow, thats really helpful, how I didnt think about it?

obviously I googled and youtubed it, but I didnt quite find this same scenario I'm in, thats why I came here hoping that someone could help me, but going by the only two replies I got I guess this one is on me.

So yes, back to the drawing board, I'll find some other way to do it, or ask it somewhere else

Id like to search for all pages of a website containing a particular word (the equivalent of Google's "word site:www.helloworld.com")

http://lmgtfy.com/?q=screaming+frog+extract+page+containing+word

--> https://www.rubenvezzoli.online/find-pages-containing-specific-text-screaming-frog/

Don't tell me you really googled it. It took me 30 second

 

[MrValdemar]

thanks but I already knew that because... well I googled it

the issue here, as I said in the OP, is that I have that word in my main menu, so screaming frog returns every single page of my website as a result.

there must be a way to filter, or for screaming frog to only look in the text of the articles for instances of the word, thats what I want, but it requires of parameters and operators I'm not really familiar with, thats why it isnt as easy as it sounds if you dont read carefully my OP, or perhaps I wasnt clear enough, in which case I apologize

 

[Elon Snup]

You can actually exctract from the HTML. Just exctract the class of your menu+ word. Should work.

 

[MrValdemar]

I dont know how to do that, thats why I came here to ask, we're going in circles

I cannot exclude results with the html of the menu option otherwise I wouldnt get any results.

I know perfectly well I need to filter out the menu option to make a search, but I dont know how, plus its not just the menu option, I need to exclude the related posts too.

Basically I need for screaming frog to only search within the articles.

If I could get a helpful answer that'd be great, thanks

 

[Elon Snup]

Drop me a private message I'll do it for you

 

[SoccerLover]