Hello dear friends,
Im creating web spider which will crawl links to find specific contents and will index in my site..more like filestube .but i didn decide which contents will index ,files,images,videos or anything else..which demand is high and any one doesnt do it yet..need your suggestion please.