So I've been wanting to learn how to scrape the web for a long time and now I have some time I've decided to give it a go. After some looking around I've decide to go with C# as I know C++ the best. Goal: Scrape search results from Google. Tools: Visual Studio and HtmlAgilityPack Point of thread: So anyone else wanting to learn this can join in to, we can all post our progress, problems etc in this thread. Progress so far: I'm using Visual Studio 2010. Have just installed the Nugent (package manager?) from HERE. I just clicked the Download link and Visual Studio recognised the link, so it installed no problem. Now when I open up V.S. I can go to the menu Tools > NuGet Package Manager and in the bottom window of the IDE I see the PM prompt. I entered: Which gave me an error saying I didn't have a solution open, so I created a new Windows Form project and tried again, after which it worked Next I've added a text box into the form and a button. The text field I'll use to enter the search query, the button will start the scraper. Next task - Figure out how to navigate to Google and enter the search query. Should I use an instance of the WebRequest class do you think? - IF ANYONE HAS ANY ADVICE ON HOW I SHOULD DO THIS PLEASE DO TELL!!! Thanks!