1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Need to Build a "Scraper" for Gov't Websites

Discussion in 'Hire a Freelancer' started by lhd333, Dec 17, 2010.

  1. lhd333

    lhd333 Newbie

    Joined:
    Mar 2, 2008
    Messages:
    45
    Likes Received:
    0
    Okay,

    So I'm not sure if scraper is the right term - perhaps "multi site searcher" but here's an example of the idea.

    In Florida, there are 60+ counties. Each county has a "tax appraiser" website, which keeps a publicly searchable database of each parcel of real estate in that county. You can generally search by name, address or id.

    (There is a list of all of the tax appraisers' websites, but I can't add URL's)

    Problem is, the counties are not connected and you must search them county by county. Furthermore, every county has its own unique site because they all hire separate web designers. It is very disjointed.

    Let's say you want to search "county 1" - you must type in last name, first with no comma - "Williams John"

    But in "county 2", you type in "Williams, John" (this time including a comma)

    I can't remember, but some of the sites may require a simple captcha.

    I'd like a site which can search every counties database and return the results in an organized fashion.

    Can anyone help me with this?
     
  2. lhd333

    lhd333 Newbie

    Joined:
    Mar 2, 2008
    Messages:
    45
    Likes Received:
    0
    I think I mislabeled this idea as a scraper.

    I basically need a universal search engine that will search the records in every county regardless of the type of database they use.

    Basically, it would be a script that worked like this:

    I type [first name] [last name].

    The script inserts these values however each county database requires it to be inputted.

    County 1 requires "Last Name, First Name" (with comma)
    County 2 requires "Last Name First Name" (no comma)

    Search returns a list of all results sorted by county. Each result would be a link to the actual property record on the county site.

    You can see a list of the appraisers here: hxxp://dor. myflorida. com/dor/property/appraisers.html
     
  3. coderjeff

    coderjeff Junior Member

    Joined:
    Nov 20, 2007
    Messages:
    130
    Likes Received:
    26
    Location:
    USA
    You want to search the ownership records in each county by owner name?

    Should be doable, but with 60+ different websites to deal with, it could take a fair amount of time just to initially check out all of the sites and see what will be involved. Most likely will be the 80/20 rule. I imagine it may be fairly easy to scrape most of the sites, but writing the code to extract data from the last 20% will probably take 80% of the effort.