Creating web spider,suggestion please!

Which content should be crawled and indexed

  • pdf

    Votes: 0 0.0%
  • image

    Votes: 0 0.0%
  • video

    Votes: 0 0.0%
  • other

    Votes: 0 0.0%

  • Total voters
    0

shansharif

Registered Member
Joined
Dec 4, 2010
Messages
83
Reaction score
33
Hello dear friends,
Im creating web spider which will crawl links to find specific contents and will index in my site..more like filestube .but i didn decide which contents will index ,files,images,videos or anything else..which demand is high and any one doesnt do it yet..need your suggestion please.
 
Back
Top