Batch Address Verification and Geocoding

 

I'm working on my first really large POI file (~800 locations) and am looking for some advice regarding tools.

The list of addresses from which I'm working is of questionable quality and is missing zip codes. I normally use GPS Visualizer's batch geocoder (http://www.gpsvisualizer.com/geocoder/) to geocode my addresses but it has a serious flaw. If the address isn't understood then it will reduce lat/lon precision from "address" to "city" without warning and returns bogus coordinates. Their single-address geocoder tells you the precision (address or city) of coordinates and returns the normalized/sanitized address including zip. While I don't mind researching and correcting bad addresses, I really don’t want to have to check hundreds of addresses one at a time in order to ensure that each is good.

Does anyone know of free tools the can either A) batch validate addresses that I could then batch geocode with GPS Visualizer or B) batch validate and geocode a list of addresses in one step?

USC WebGIS Geocoder

USC has developed a new site for geocoding address data which is free - https://webgis.usc.edu - It can process databases of addresses or single ones and does address parsing and normalization on the addresses first automatically. This might be what you are looking for.

A suggestion

From first hand experience - after you do the geocoding - whether it be a single or batch geocoding - I have found it necessary in most cases to try to verify the coordinates with Google Earth or one of it's "equivalents" in an attempt to insure coordinate accuracy.

--
MrKenFL- "Money can't buy you happiness .. But it does bring you a more pleasant form of misery." NUVI 260, Nuvi 1490LMT & Nuvi 2595LMT all with 2014.4 maps !

I just tried the usc site

dwgold wrote:

USC has developed a new site for geocoding address data which is free - https://webgis.usc.edu - It can process databases of addresses or single ones and does address parsing and normalization on the addresses first automatically. This might be what you are looking for.

It nailed my home address, it looks like it is the coordinates of where I am sitting in my house.... shock Spooky

I am anxious to try it with some of the pois I maintain...

--
It is terrible to speak well and be wrong. -Sophocles snɥɔnıɥdoɐ aka ʎɹɐƃ

I just tried

I just tried 3 geocoding sites with my address:

https://webgis.usc.edu returned a solution 1 mile away from my house.

GeoCoder was within 1 house

GPSVisualizer was within 2 houses

I double checked my coordinates with my Magellan eXplorist 100

--
MrKenFL- "Money can't buy you happiness .. But it does bring you a more pleasant form of misery." NUVI 260, Nuvi 1490LMT & Nuvi 2595LMT all with 2014.4 maps !

I tried thu USC decoder with an update address for a poi..

MrKenFL wrote:

I just tried 3 geocoding sites with my address:

https://webgis.usc.edu returned a solution 1 mile away from my house.

GeoCoder was within 1 house

GPSVisualizer was within 2 houses

I double checked my coordinates with my Magellan eXplorist 100

It wasn't even close... But it was an address in a newly developed area, gpsvisulizer did do a better job, the person who submitted the correction matched the location given by the store finder... It's been said many times the geodecoders may get you close but you still have to confirm the information...

Edit: When I used my home address I used my complete zip code (xxxxx-xxxx), this may have made it much more accurate. I guess you could look up complete zips at the usps.com... I'll have to check that out.

Edit edit: I just tried the same address with the complete zip:407 GEORGE CLAUS BLVD SEVERN MD 21144-1317. It is the address of a Walmart. USC site was unable to decode it. Gpsvisulizer gave the coordinates of: 39.103380, -76.685739. Actual coordinates are: 39.145138 -76.648425.... So at least the USC site didn't give me incorrect coordinates..
BTW You can get complete zips at usps.com...

--
It is terrible to speak well and be wrong. -Sophocles snɥɔnıɥdoɐ aka ʎɹɐƃ

usc site

aophiuchus wrote:
dwgold wrote:

USC has developed a new site for geocoding address data which is free - https://webgis.usc.edu - It can process databases of addresses or single ones and does address parsing and normalization on the addresses first automatically. This might be what you are looking for.

It nailed my home address, it looks like it is the coordinates of where I am sitting in my house.... shock Spooky

I am anxious to try it with some of the pois I maintain...

It put my house 3 houses east of where it's supposed to be, which is what all of the geocoding sites do. It also said my block went up to 1998 so I had it geocode that address and it put it in the middle of the next street west of me. My block goes to 1972.

--
Anytime you have a 50-50 chance of getting something right, there's a 90% probability you'll get it wrong.

.

None of the replies so far have addressed the OP's main point - that of Geocoding interfaces that returned degraded results (wild guesses?), without telling you.

(If you dig around in this forum long enough, you'll find a post by GPSVISUALIZER's owner, explaining that the result precision is not available through the AJAX interface to the Yahoo! Geocoder, used for Batch Geocoding.)

I do have a solution, but it doesn't meet the OP's requirement of being free.

--
------------------------ Phil Hornby, Stockport, England ----------------------               http://GeePeeEx.com - Garmin POI Creation made easy           »      

And that solution is....

Hornbyp wrote:

I do have a solution, but it doesn't meet the OP's requirement of being free.

?????????????shock

--
It is terrible to speak well and be wrong. -Sophocles snɥɔnıɥdoɐ aka ʎɹɐƃ

.

aophiuchus wrote:

and that solution is...
?????????????shock

GeePeeEx Editor's Batch Geocoder interface has a pull-down option: 'Minimum Precision Required' So if you've specified "Address" level precision and Yahoo!'s Geocoder returns the coordinates of the city-centre instead, that result will not be used.

--
------------------------ Phil Hornby, Stockport, England ----------------------               http://GeePeeEx.com - Garmin POI Creation made easy           »      

What would happen?

Hornbyp wrote:
aophiuchus wrote:

and that solution is...
?????????????shock

GeePeeEx Editor's Batch Geocoder interface has a pull-down option: 'Minimum Precision Required' So if you've specified "Address" level precision and Yahoo!'s Geocoder returns the coordinates of the city-centre instead, that result will not be used.

No coordinates or a message or ???

--
It is terrible to speak well and be wrong. -Sophocles snɥɔnıɥdoɐ aka ʎɹɐƃ

.

aophiuchus wrote:

What would happen
No coordinates or a message or ???

If you recall, it changes the colour of the entries it's geocoded - so you can see at a glance, the ones that require attention.
Or, you can set an option to abort the run on a failure. It depends if you want to fix one at a time, or sort out all the 'duds' together.

--
------------------------ Phil Hornby, Stockport, England ----------------------               http://GeePeeEx.com - Garmin POI Creation made easy           »      

Boy oh Boy...

Hornbyp wrote:
aophiuchus wrote:

What would happen
No coordinates or a message or ???

If you recall, it changes the colour of the entries it's geocoded - so you can see at a glance, the ones that require attention.
Or, you can set an option to abort the run on a failure. It depends if you want to fix one at a time, or sort out all the 'duds' together.

I just ran the Combined WalMart file through GeePeeEx batch decoder and about 300 or so of them failed.... That means just a street or city was used, hopefully they are all closer than a state... I can see what I'll be doing for a while...

--
It is terrible to speak well and be wrong. -Sophocles snɥɔnıɥdoɐ aka ʎɹɐƃ

USC WebGIS Geocoder gives accuracy values

The USC geocoder https://webgis.usc.edu may fail in some cases, but it does tell you what accuracy the (degraded) output geocode is - to the level of geographic feature matched. See toward the bottom of https://webgis.usc.edu/Services/Geocode/TechnicalDetails.asp... - If you process a database, you can sort by this quality field to see the ones that are of less-than-desirable accuracy without having to pick through the records one by one.

goint to have to try this one..

I use a few but all are not to reliable.. I will love to try this one too.. will let you know what i think.

--
Bobkz - Garmin Nuvi 3597LMTHD/2455LMT/C530/C580- "Pain Is Fear Leaving The Body - Semper Fidelis"

sample of an acceptable file format?

dwgold wrote:

USC has developed a new site for geocoding address data which is free - https://webgis.usc.edu - It can process databases of addresses or single ones and does address parsing and normalization on the addresses first automatically. This might be what you are looking for.

I'm trying to use this service, but to do so I apparently have to get my data into a format that they like. While I have found tables and charts on their website, it's proving hard to decipher these and exactly match them to my data. To my surprise, there seem to be no sample files available that I can just look at and make my data look like.

Can anyone provide a sample file of a few lines of data that they have used for this (or any other free service that they would recommend). text or CSV file formats would be preferred, but I could also submit data in spreadsheet for or other common forms. I would rather not submit as an SQL database at this time, although a site that accepts databases would be very welcme in the future.

USC WebGIS Geocoder Sample data files

Frovingslosh wrote:

I'm trying to use this service, but to do so I apparently have to get my data into a format that they like. While I have found tables and charts on their website, it's proving hard to decipher these and exactly match them to my data. To my surprise, there seem to be no sample files available that I can just look at and make my data look like.

Can anyone provide a sample file of a few lines of data that they have used for this (or any other free service that they would recommend). text or CSV file formats would be preferred, but I could also submit data in spreadsheet for or other common forms. I would rather not submit as an SQL database at this time, although a site that accepts databases would be very welcme in the future.

Sample data files are available at: https://webgis.usc.edu/Services/Geocode/SampleData.aspx