1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Is there a software that can infinitely crawl a site for links?

Discussion in 'BlackHat Lounge' started by karma05, Jan 17, 2017.

  1. karma05

    karma05 Regular Member

    Joined:
    May 30, 2013
    Messages:
    384
    Likes Received:
    21
    Location:
    Ramsdale
    Say if I wanted to crawl Pinterest for Twitter profiles for example, is there a software that could keep deep crawling through to other pins and save all Twitter profile links it finds along the way?