url checker

We all Know Google Has Stopped The Public Indexing of Url But I see Many Peoples is Crwal Our Url's So any one know how I crwal My url's

Hey Guys I hope you can help me out here... Now, There may be a pretty simple solution to this,and I hope there is. I was wondering if there's a tool to show ALL the locations or websites a particular url was placed. Example: I have an old bitly link that I realize was getting a lot of traffic...

I have may be 10000 forum's links I search a script can check inside each page of my forum link, if my URL stay inside. Do you know some software or script can do it ? Sorry for my bad english Chris