1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Ideas to search blog comments better?

Discussion in 'Blogging' started by NTG98, Mar 1, 2012.

  1. NTG98

    NTG98 Junior Member

    Joined:
    May 27, 2009
    Messages:
    128
    Likes Received:
    12
    Occupation:
    Student
    Location:
    Texas
    I'm working on a project where I have to search the entire 2.0 web for various keywords.

    I want to find a clever way of searching through individual forum posts and blog comments, not just posts by the author of the blog but by individuals in the comments section. Ie I want to scrape every possible blog comment and message board post containing said keyword.

    Now I've gone through various different footprints in google but it just isn't very good. I'll get a few results yes, but a lot of the individual comments themselves don't show up in the SERPs- just the main blog post does.

    Does anyone have any ideas? This is kind of a massive undertaking... I thought about wgetting every single damn moderately-trafficked blog but that would take a lot of resources...

    Thanks