Which language for spider/crawler

Python with Scrapy will do just this sort of thing, and is extremely easy for beginners. You can have a fully functional crawler/scraper with about 20 lines of code, and can use something like Django with Django Dynamic Scraper to set up a web interface for controlling your spiders.