How to scrape URL which contains specific character?

N

night undertaker

BANNED

May 30, 2012

56

21

• Dec 5, 2018

• #1

Hey guys,

I want to scrape URLs of a site which contain "?" character in Google. What kind of operator should I use?

Thanks

 

D

Deleted member 813988

Guest

• Dec 5, 2018

• #2

? - html code for question mark

 

S

saianudeep

Newbie

Aug 14, 2018

11

2

• Dec 5, 2018

• #3

You can write a small robot using Web Robots Scraper and run it on your PC using Chrome browser. It will mimic exact steps you are doing manually. Using Web Robots scraper requires basic Javascript language skills.

Disclosure: I work at Web Robots and do similar robots almost on daily basis.

 

y sharifpour

Newbie

Nov 24, 2018

11

3

• Dec 6, 2018

• #4

you can search like this in Google ( called this google dork ) :
site:xsite.com inurl:?test
But you should enter the other character after "?".