Extra_POI_Editor - A tool to View/Edit/Convert POI/TourGuides (Part 1)

Confirmed, 4.39 fixed the Save to Garmin CSV. That train is back on the tracks again. Thank you Turboccc

You are killing me, man! LOL! Where are you getting your files from ...

Seriously, post me a link to that file and I'll try again until I get it right.

Thanks,

Turbo

Here is an example

http://www.poi-factory.com/node/3712

I removed and reinstalled EPE from my computer a few betas ago to see if I had a problem. That didn't help.

Maybe it isn't worth the grief.

First of All, I have not used EPE for batch geocoding and was wondering if someone could explain the process/step to perform this task.

Question:

Do I need to separate the file from those that need coding and those that have been coded?

Is there a coor verification process? I maintain a huge file (over 6000 entires) and was wondering if there was a way to verify the coors are within 1 block or so of address (MAYBE this feature can be added if it does not exist)?

Is there a limit on the amout of entries that can be geocode at one time?

Thanks for your help.

Updates: I am not sure if V422 has a problem or maybe I have the problem but I created a file with poi locations with no coor and then tried to batch geocode the info. The program seem to complete and asked me if I would like to review the problem logs in notepad?. I replied yes, it could not find the notepad program and then failed/terminated without returning to the geocoded data/EPE program.

No idea if my data/steps are correct.

First item is you need to upgrade the version you are using from 4.22 to at least 4.31. The program is up to 4.39 Beta, but 4.31 will handle CSV files.

Be certain you specify which columns are to have the lat/lon under MColumn Options. This is where you tell EPE which column contains what data.

When EPE reads a record that does not have all the fields, it will pop up a window asking you to do one of two things - either accept or delete the record. There is a check box to apply your answer to any additional records.

I'm not certain if the Bulk geocode includes records already having data or not. I suspect it doesn't from working with a large file that has been partially geocoded (it starts by stating 30% of the file is already done.)

I can't understand why you don't have Notepad, it's one of those utilities that comes as part of Windoze like chkdsk.

I checked TurboCCC's site and the latest version is 4.22. Is version 4.2x to 4.39 Beta versions?

I have access to Notepad but apparently the search path for EPE is incorrect which may causing the early termination.

Probably my fault. I am looking for Notepad in C:\WINDOWS\notepad.exe. I did the lazy thing, but I can correct this mistake.

Do you have Vista? On Vista, Notepad is located in C:\windows\system32\notepad.exe

Thanks,

Turbo

N.B. All 3.x versions are betas. V3.39 is the latest and stable, however it will have the same Notepad issue as 4.22.

No, I am not using Vista. I will search for the file and post the path in the morning.

Does EPE have a feature to verify coor to address (within some range)?

After more tests, it seems I can read formatted phone numbers in xls file, but file reading will take 40+ times slower to read.

For example, a 2000 xls POI files takes normally less than a second to read. If I read the formatted xls cells, it takes around than 35 seconds to read the same file. A bit too long for my taste. If I just read the formatted cells for the phone numbers, it takes 5 seconds.

Then what? Formatted postcode columns, ... We'll get back to 35 seconds in no time. I am not sure what to do. It could be user programmable. I could pop-up a window and ask.

One other tiedous option is to save each sheet as CSV and make a copy & paste to bring back the phone as a properly formated string.

One final option is to provide a phone format in the preferences and EPE will reformat any phone number to the desired format. For example, (###) ###-#### will convert 1234567890, 123.456.7890 or 123-456-7890 to (123) 456-7890. Looks nice at first, but what about european numbers? Should I do this automatically depending on the number of phone digits?

Nothing is easy when we want everything perfect. That's why I never reformatted the phone numbers in the first place.

Comments + opinions and good ideas are welcomed.

Best regards,

Turbo

The default path in XP is C:\WINDOWS\system32\notepad.exe

I am not sure to understand exactly what you want. Tell me which one is right:

1- Do geocoding from address and compare current coordinates with the ones from the geocoder.

2- Do reverse geocoding from coordinates and compare with the current address.

Probably 1. No, EPE does not do that, but it would be easy to do.

How many geocoding can be done in a day? I do not remember. You can check on google (google is the geocoder). Was it 50000 per day?

So far, EPE will geocode only POI without coordinates.

Turbo

Have you tested to see how long it would take to write the file with formatted phone numbers?

I'm no whiz on the Excel APIs, but how does Excel handle it? Would it be based on the language option or country selected? For North America, the number format follows the NANP or North American Numbering Plan. I'm certain other countries also have standard formats so if a person indicated the country, the proper format could be determined. But then again, how many users do you have outside NA? Not many I would venture. The option could be to format the field according to the NANP or leave it unformatted. That could be the option choice.

Yes, Option #1.

I would like to verify 6000 entries to see if the coor in the file are within 1 city block of address.

I suggest maybe changing the coor color to RED or something similar for coors that exceed some reasonable variance.

I vote for #1.

Garmin POI format

I have an Excel file that contains Addresses, phone numbers and a name for each address. Is there a way that I can create a csv file and load it into Extra_POI_Loader and then do a "Batch Geocoding" to get the Longitude and Latitude for each location?
Example: Location name,street,city,state,phone #

I know that the first two fields of the csv have to be blank for the Long and Lat.

Just trying to find a way to import data into Extra_POI_Loader

Windows 2000:

path: c:\winnt & c:\winnt\system32 (both places)

BOBWILL, Setup the MColumn Options preference/fields and then open and batch scan. See A-USER post a few replies back.

You can do this. Save the Excel file as a CSV. Open EPE and in the option screens select MColumn. State what data is in what column (and point to two empty columns for lat/lon).

Tell EPE to read the file, it will give you an error but tell it to ignore the error and apply that answer to the remainder of the file.

Once the file has been read in, use tools to select Bulk Geocode. Resolve the unresolved addresses and then save.

bobwill,

Why not read the xls file directly? If you use one of the beta I posted lately, you can read the xls file directly. As said, just set the column assignment in the "M-Column Assignment" under Options. Then do a File-Open and specify the file type as "M-Column XLS" (or M-Column CSV if you prefer that).

a_user,

I tried it yesterday. It takes around 10 seconds to save all sheet to CSV. Then, I need to parse all the CSV. Yes, it will not take 35 seconds, but still it will be greater than 10 seconds. Maybe 15 seconds. I am usually not that patient.

Notepad issue: ok, path to Notepad is corrected for next release.

"All good things come to he who waits."

Really, when you get down to it 15 seconds is usually less time than it takes the GPS to do a search for the closest poi. 35 seconds does seem like an eternity though.

You are probably right. For me, 15 seconds is just too long because I load, check, make change to EPE and load again.

I hate the fact I need to create lots of temporary csv files. If EPE is closed while processing, this/those file(s) stay on the system. In 1 second, you don't have the time to worry about it. Also, I have made many tests with 40000 POIs (yes, the number of zeros is good!) and more. This means 20 times 15 seconds... 5 minutes! Help!

Anyways, I'll see what I can do. If this can be decided by the user, then why not. A progress bar would be definitively required.

Honestly folks, for the amount of data this crunches, 30 seconds is great! Or, you can go back to doing it the old way...

Great job, Turboccc!

Thanks Juggernaut!

BTW, you may have noticed the only one complaining about the 30 seconds is me. LOL!

Turbo

Hi Turbo,
Getting a run-time error 380..

Even if I try to create as a new gps file.

Also I could load a very large but then I took out just 4 lines to test something and got the same error. just a fyi

Hi Bobkz,

Which version are you using?

Can you tell me the exact steps you made? I tried opening, loading, deleting, create new, but never got the error.

Thanks,

Turbo

Turbo,

Please add a link to the beta version on your download page.

Done. You will find it in the Extra_POI_Editor page. Not on the download page.

Turbo,
Had a couple of problems with version 4.22 not displaying any of the loaded poi's in the list pane. At the time I was using a small file with only two poi's in the file. It worked fine with a couple of large poi files that I tried.

The information just above the pane would show 2 poi's loaded and that it was displaying POI 1, however nothing was visible in the pane. The preview pane would be showing the poi correctly. Also, if I tried to add a poi from the list pane, I got an error (I believe it was 380) and the program shut down.

I reinstalled version 4.21 and everything worked fine. Did another install of 4.22 and the same problem returned.

getround....

Hi getround,

That's pretty weird. I could reproduce the problem with v4.22, but it seems not to be there in latest beta. Please visit my web site and download the latest beta v4.39. You will not find it on the download page, but rather in the Extra_POI_Page in the download section.

Please, let me know if you can reproduce the problem with that version.

Thanks,

Turbo

Thanks for your quick response. I will give the beta a spin. I will le you know if the problem returns.

Turbo,

Can I install the beta over top of the initial install, or do I uninstall first?

Hi Juggernaut,

You can overwrite. Install is only required once if you are missing some OCX files (library files). Otherwise it is not required.

In your case, you can overwrite and all will be fine. Just drag & drop the entire zip in your current EPE folder.

Thanks for the quick answer on that.

TurboCC..

Thanks for all of your help.. I did get a chance to repond to you before, but I was having the same kind off issues as the other user had.

I got the beta one now and retried what I was doing and it seems to work onece again. I want to use it to update the offbeat file that i have since I have so many more places to add.

I will let you know how it goes!

Thank you for a fantastic program. I have tryed the
EPE for some time now, and it`s getting better end better. I tried to save som Poi as ov2 file ,but i was getting a Run-time error 13 Type mismatch. I am pretty sure I have saved as ov2 before without trouble.
It is only when saving as ov2 I am getting the error.
I think the problem must be om my Pc, but what?
Anyone know what this can be?

Sorry if my English is bad.
Inge.

Hi vestenfjell,

I do not get any error while saving to an OV2 file. The latest beta version of EPE is v4.39. You can find it on the Extra_POI_Editor page on my site. It is not on the Download page yet. Please try that one.

If the problem persists, please email me the file causing you problems.

Are you loading and saving an OV2 file? Are you loading a GPX and saving to OV2? At next post, please give me all the steps required to reproduce the problem. I'll find the problem for sure.

Thanks,

Turbo

I am loading a gpx file and save it as ov2.
Just now I tried to open a ov2 file, and got the same error. I have tried the v4.39. beta, and several other versjons, but its all the same problem. But Im pretty sure I have saved as ov2 before.
Its not in one file I get the error ,but any file I try to open or save as ov2.

Im running Win xp.

Vestenfjell

Turbo, let me know if this option is on your to-do list.

I am sure many people would appreciate this feature.

Thanks

Hi DRMCMTR,

It used to be a couple months ago, but I never did it.

Do you want me to add a distance threshold? If less than x meters/feet, then assume the coordinate is good and forget about it? I am not sure if it is worth it because geocoding is generally not very good. I am trying to find a way not to list the 1000's POI in a file...

How do you want to see the result? I could display a table like the one resulting from "Find Duplicates". I could display the geocoder coordinates and the distance to the actual coordinates. Too bad the map is occulted, because I surely like to display both POIs on the map. I will think about this.

I would like to find a way to mark POI that were already checked by geocoding to avoid doing this on this POI file. Let's say you add new POIs in the future and you want to do this again. Can you imagine to verify all POIs again?

Any other ideas?

Turbo

Hi vestenfjell,

I sent you an email.

I just also thought I may have found what is causing you the problem. Check your lon/lat coordinates. Is it possible you used commas instead of the dot in the coordinates.

Like: -73,2321
Instead of: -73.2321 ?

That would cause the issue. I can correct the problem if this is a normal case and not a mistake.

Thanks,

Turbo

Europeans used to (still do?) use a comma in place of the period we use in the USA.

Hi garygid,

Yes, this is still true, but I thought the GPX format allowed only a decimal dot. All POIs I found from Europe seems to have a dot in the log/lat, however they are often displayed with a comma in the text.

His problem may have been caused by a C&P from European sites. Once I know more about the reason for the problem, I'll issue a fix.

Turbo

I am trying to run the editor using wine on Ubuntu linux. The program loads and opens data files great. The problem is when accessing Google maps an error is returned saying that the program needs a different Google Maps API key.

Any suggestion how to solve that problem? The message also refers to a google web page but I am lost there.

All is well when running from windows xp native mode...

It's been a little while since I've downloaded the latest version. The previous version was so good I never thought of looking for an update until I started working with some really big POI files.

Could I suggest/beg for three new features? (All in the interest of cutting a very large POI file down to size.)

1. Ability to crop a very large POI file (I was thinking about specifying upper and lower bounds of lat and lon to define a box inside which the POI files would be kept. All others would be discarded.)

Note: I see an export by State option in 4.39, but it only gives me complete lists with _none appended to them. On the subject POI files, I notice the State field is not filled in, but the complete address with city, state, zip, and phone are in the Address field in the POI Edit dialog and the dialog's city, state, and Post Code are all blank.

2. Ability to average the lat/lon numbers of duplicate POI's. (So if you have one POI near the north side of a location and another near the south side, the averaged numbers would hopefully be somewhere near the middle.)

3. A search/remove function (such as if a specified string is found in a POI name, the point is discarded.)

Edit: I just used the batch reverse geocoding feature to fill in the state. I can now use the export by state option.

Yes, I agree that marking the coor as checked would be nice but that would require a dedicated marker (POI Verified) or something similar to avoid running the same check again. Please add this mark.

A distance threshold is mandatory for +/- distance off the orig coor. I suggest this to be in the preferences setup defaulted to 1 city block or so. Some people may want greater threshold due to subject/location (state parks in Wyoming - large open areas)?

Displaying the two coor on the map would be nice but if that is not easy then why not add 2 new fields for proposed coor on the detail poi list (avoid creating a pop list of errors). Add a button
to accept new proposed coor for easy maintenance.
Maybe add a button to open a new window displaying
the proposed coor map so that we can compare and update as needed (if you can't display the two in the EPE internal map)
I am not familiar with the find dup option.

Maybe use a color scheme to indicate errors (color the orig coor field):

Green: Coor within threshold.
Yellow: Coor outside threshold.
Red: Can't geocode poi from address

Maybe a scroll button (prev/next) to jump to the next entry that need attention (yellow or red errors) for easy maintenance.

Some stats would be nice to see how the overall file is composed: 80% of coor are valid (or so).

These are all just my ideas maybe others will add their or correct my purposed solutions.

Hi, turbo I sent you an e-mail.

I dont use comma in lat/lon but a dot.

Hope not im causes to much trouble and work for you with resolve this problem.

Vestenfjell.

No worries vestenfjell.

Now it is "personal". I have to reproduce it because it kills me not to find the issue.

Turbo

I have been noticing something and would wounder if you know why.. If I put the full address in your adderess and do a lookup for the cord, I get 1 set of numbers, Now If I break out the address and put it in the correct areas, you know, city, state, zip.. then do a lookup, i get a new set of numbers, just wondering why.. which is a better method. I really want to get to the location as close as I can... I would hate to see people using my poi files and can not find whare I am sending them..

Thanks in advance..

Bob, I tried to reproduce what I think you are saying and I get the exact coordinates each way. I put in my house address in the Address block, 1st as a string with commas after the street, city, state, etc. I then rewrote it as you would see it on an envelop, and finally with the street address only in the Address block and the other info in their specific fields. In each case, I got the same coordinates back when I selected the Geocoding button. I am using EPE 4.39

I am curious to know what source EPE uses for geocoding. When I plug my address into MapSource, Google, Bing, Navteq or Streets & Trips, it shows my house at the wrong end of the block. EPE pegs it right where it really is.

what I might be seeing is that when I 1st used the system i "copied everything in the address book feild, then did a lookup and got the info, and that was using a csv file, I then since upgraded to his beta and now I am using a gpx file and the address is setup right (Turbo set it for me.. THANKS for that btw..) and now I am doing a new lookup and it is getting new cord. SDhould have said that before.

I just want these location to be correct so that I can republish my new copy of Offbeat loacations.. Got a lot of new and fun places to go..

Ok, you had an existing file with coordinates; when you load this file into EPE and click the Geocoding button, you get different coordinates. Is that it?

If so, your original location my have been calculated from a different spot. The original may have been geocoded to the front door of a business, a street address, or the entrance to the parking lot, etc., or the coordinates could have been completely off for some other reason. EPE is looking at the legal street address and comes up with the coordinates that are published for it. However, sometimes the point is not at the published street address, possibly due to a street renumbering project that hasn't made it to the databases yet. This is particularly true in rural areas where 911 projects changed lots of things to build a standard for the EMT folks to respond to an emergency call.

There are differing opinions on the best way to do this, some require more work than others, but I agree with you, if I put up a POI file, I want to be sure the coordinates are as good as they can be. It's a real bummer to go looking for something and when you arrive it is a cow pasture as far as you can see in either direction (no offense meant to cow pastures).

I start by inputting the street address into EPE, clicking on Geocoding and then scrutinize the coordinates by zooming in on the hybrid view. If I need to move the map pin, I drag it to the spot I want, typically the driveway apron onto the street and then click on Grab to change the coordinates to where I dropped the pin. Sometimes I have to copy - paste the coordinates into Google Earth and then use the street view photos of that location to be sure I'm in front of the location I'm looking for. If not, I use Google Earth to better locate the point and then copy it back to EPE and save it.

I'll bet someone has a better way of doing this, and I would like to know about it also, but this has worked for me so far.