1. This website uses cookies to improve service and provide a tailored user experience. By using this site, you agree to this use. See our Cookie Policy.
    Dismiss Notice

How to scrape URL which contains specific character?

Discussion in 'White Hat SEO' started by night undertaker, Dec 5, 2018.

  1. night undertaker

    night undertaker BANNED BANNED

    Joined:
    May 30, 2012
    Messages:
    56
    Likes Received:
    21
    Hey guys,

    I want to scrape URLs of a site which contain "?" character in Google. What kind of operator should I use?

    Thanks
     
  2. se900se

    se900se Jr. VIP Jr. VIP

    Joined:
    Oct 14, 2014
    Messages:
    3,979
    Likes Received:
    2,070
    Occupation:
    Traffic Arbitrage
    Location:
    New York
    Home Page:
    ? - html code for question mark
     
  3. saianudeep

    saianudeep Newbie

    Joined:
    Aug 14, 2018
    Messages:
    11
    Likes Received:
    2
    Gender:
    Male
    Occupation:
    SEO
    Location:
    Hyderabad ,India
    Home Page:
    You can write a small robot using Web Robots Scraper and run it on your PC using Chrome browser. It will mimic exact steps you are doing manually. Using Web Robots scraper requires basic Javascript language skills.

    Disclosure: I work at Web Robots and do similar robots almost on daily basis.
     
  4. y sharifpour

    y sharifpour Newbie

    Joined:
    Nov 24, 2018
    Messages:
    2
    Likes Received:
    1
    you can search like this in Google ( called this google dork ) :
    site:xsite.com inurl:?test
    But you should enter the other character after "?".
     
    • Thanks Thanks x 1