1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Any tool to scrape urls from google blog search engine?

Discussion in 'Black Hat SEO Tools' started by Ruriko, Jun 2, 2009.

  1. Ruriko

    Ruriko Power Member

    Joined:
    May 4, 2008
    Messages:
    524
    Likes Received:
    12
    Anyone know a tool that can scrape urls from google's blog search engine?
     
  2. revit

    revit BANNED BANNED

    Joined:
    Apr 24, 2009
    Messages:
    266
    Likes Received:
    370
    What would be nice is to have a scrape tool to scrape URLS from the Do-Follow search engines.
     
  3. xr4ti

    xr4ti Registered Member

    Joined:
    May 27, 2009
    Messages:
    72
    Likes Received:
    9
    '*******************************************************************
    'Scrape a page's content into a string
    Public Function GetHttp(Byval Url)
    Dim objXml
    Set objXml = createobject("MSXML2.ServerXMLHTTP")
    objXml.open "GET", URL, false
    objXml.send()
    If Err <> 0 then
    GetHttp = "Error: " & err.description
    End If
    if len(objXml.ResponseText) > 0 then
    GetHttp = objXml.ResponseText
    else
    GetHttp = "There is no content."
    end if
    Set objXml = Nothing
    End Function
    '*******************************************************************
    'Get the content to display based on a regExp pattern
    Public Function GetContent(strContent, strPattern)
    Dim objRegExp, Matches
    Set objRegExp = New RegExp
    objRegExp.Pattern = strPattern
    objRegExp.IgnoreCase = True
    objRegExp.Global = True
    Set Matches = objRegExp.Execute(strContent)
    for each match in Matches
    GetContent = GetContent & match.Value
    next
    Set objRegExp = Nothing
    End Function

    'example:
    dim strURL : strURL = "urltoscrapehere"
    strFullContent = GetHttp(strURL)
    response.write(GetContent(strFullContent,"<a href=(.*?)>"))






    this is old and is in classic asp but i have used script like this many times to do exactly what your looking to do. I hope that this can help you out. You might need to spoof to make it look like it's coming from a browser for google. If you need any more help gettingthis going PM me and I can see what I can find.
     
  4. rprabu

    rprabu Power Member

    Joined:
    Feb 11, 2009
    Messages:
    580
    Likes Received:
    261
    Location:
    Home :-)
    scrap genius is a good tool check out here
     
  5. Ruriko

    Ruriko Power Member

    Joined:
    May 4, 2008
    Messages:
    524
    Likes Received:
    12
    scrape genius only uses google search engine. I want to use the google blog search engine