Batch POI download utility available

Make sure that you have macros enabled, from the Excel menu, go to Tools, Macro, Security and select medium security level. Then close and reopen the spreadsheet.
When you CLICK ON STEP 1 MACRO BUTTON, a "Browse for Folder" dialog box should popup and then you can select your POI folder.

It will select one level of ALL folders and files within the POI folder (\POI\RESTAURANTS,\POI\STORES) etc.

Jake88
I was able to complete macro step 1, New xls listed all folders, sub-folders, file names and extensions, saved new file to my desktop as MyPOIs List.xls, pasted MyPOIs List.xls column A to POI List.xls column B, VB macro 2 failed to copy list to POI files.txt. Your help instruction to A_user are not as seen when I run macro 2.

I am unable to complete functionality.

I don't see why anyone would want a list of folder, sub-folder and POI file names.

My excel worksheet performs different tasks than your VB worksheet. I will send you and A_user copies to try out.

There are three worksheets, Avail Combo's, Avail Sort Columns, and WorkingCopy

Avail Combo's (locked example sheet), instructions shows of two links and possible target download configurations.

Avail Sort Columns (locked example sheet), instructions on how to sort POI categories and\or POI file names.

WorkingCopy (unlocked sheet, column J locked)

Instructions
Column A - Enter link
Column B - Enter target directory
Column C - Select Yes to add date to target directory, no date if left blank
Column D - Enter target sub-directory
Column E - Select Yes to add date to target sub-directory, no date if left blank
Column F - Enter POI category type
Column G - Enter POI file name
Column H - Select Yes to add date to POI file name, no date if left blank
Column I - Enter extension
Column J - When all records entered sort file by POI category and/or POI file name. When sorted as preferred, copy and paste to poiFile.txt

Happy to answer any other questions
Phil

I'm unable to contact you, enable contact tab in your user profile or click my contact tab and message me, I'll send you a copy of my POIbuilder downloader.

Phil

All files will be copied
Test1
Selected C:\MyPOIs\Garmin
Results all files in folder Garmin, sub-folder Express and sub-folder Manual
Test2
Selected C:\MyPOIs
Results all files in Sub-folder Garmin, sub-sub-folder Express and Manual, plus sub-folder RLC, sub-folder TomTom, sub-sub-folder Express and Manual

Jake,

I got it to work up through step 5, but I don't know what you mean when you ask me to copy the links from the download page. Are you assuming that my file name match the name of the file on POI Factory and I am to copy the link that points to the file?

As an example, Mahoney has the McDonald's file as a CSV. I have it with a slightly different name and converted to a GPX because I want dialable phone numbers. So what gets linked to what? And then, when you run POISync, can you specify a target set of folders or does it assume I want to over write my massaged files?

phillyguy19020

The Step 3 button (column C) copies the list to POI-files.txt. If you open my origional file and click macro 3 button, it should generate a text file identical to shumans poiFiles-sample.txt. Notepad should automatically open the file. If that doesn't work, you may need to install the Analysis Toolpak add-in from the Microsoft disks. It sounds like a lot of hassle, but the file works great. I believe that it will be useful for anyone that has many POI files they want to download.

This is another method with a batch file:
1: Open Notepad
2: Copy and past this text:

cd\garmin\poi
dir /s /b *.csv *.gpx *.ov2 > List.txt
notepad c:\garmin\poi\list.txt

(modify paths to your directory structure)
3: Save as list.bat
4: Double click on list.bat to generate List.txt
5: That data can be pasted into column B of the Excel File. No lines need to be parsed out.

Thanks for looking at it. I'll enable my contact tab.

Check this out:
http://www.poi-factory.com/node/27442

Any way to link it to your program? That would make it really easy to stay updated!

Thanks,

Larry

Larry,
You need to create lines of download info for the utility to work. I've already looked at my favorite list, Jon has made this task so much easier.

Copy and paste the favorites list into a text file, removed unwanted lines, change the file names as you prefer having, get the links for each line your keeping, add the target folders before the file name, and save file as poiFiles.txt.

I created a spreadsheet which will configure each line including added the date to folder name, to sub-folder name, and/or file name. If interested message me for the spreadsheet.

Phil

I've been in contact with Jon. This list will be handy to figure out which files have been updated since the last update.

I've been working on the next version which will have a full user interface to make managing the download list easier. So hopefully creating an initial list will be easier with the new version also.

This is a link to an Excel file that will extract the hyperlink data from "My Favorite Files"

http://www.datafilehost.com/download-2ac290ca.html

Excel macros need to be enabled for this to work. Just copy your "My Favorite Files" data (files & dates), paste it into the Excel worksheet Column A and click the extract button.

Shumans,

In rev. 1.0.4 you added the capability of displaying download messaging (to the screen) for the POI factory file names to the screen as well as the local file names. If a file(s) fails to download, that data is displayed, but the data goes by so fast, it is difficult to read. You mentioned that you are working on a new interface. It would be helpful to know which files failed to download.

I modified the poisync.bat batch file to generate a "Download.log" text file for each download. It redirects the screen data to provide a date and time stamped file list of the most recent download. Each time the batch file is run, it will overwrite the previous Download.log file. Notepad will open the Download.log file for viewing. For this to work, it was necessary to remove the @echo off line.

The last line folder path should be modified to the same folder where poisycn.bat is located.

if %1x==x goto default
goto override

:default
date /t>poiFiles.txt>Download.log 2>&1
time /t>>poiFiles.txt>>Download.log 2>&1
java -jar .\lib\poisync.jar poiFiles.txt>>Download.log 2>&1
goto end

:override
java -jar .\lib\poisync.jar %1
goto end

:end
Notepad.exe C:\Garmin\poisync\poisync\Download.log
- - - - - - - - - - - - - - -
BATCH FILES ROCK !!!

Now that is useful! Not only does it write the log, it opens the file.

Phillyguy,

Should you not have the same redirection at the "override" segment.

Just a minor suggestion.

I'm also old school, so I like them batch files and all the tricks and amazing stuff you can do.

JCA

JCA,

You suggested adding the redirection code at the "override" segment. I took your suggestion and forced the batch file to go to the override. The results that were piped to the download.log was in my opinion, not useful information.

If try that modification yourself and it generates information that you consider to be useful, I want to know what you are seeing.

Respectfully,
Jake88

It seems we are making this somewhat complicated tool a lot more complicated...

Jake,

I was only looking at the batch file. It seems to me that at override, you only use a specified file instead of the default poiFiles.txt. So I would expect the output to look the same.

I will try it a bit later when I get a chance.

JCA

Yes, I hope the new interface will address this problem. The failures will show up in bold and red, and you'll be able to scroll around to easily find the ones that failed. I'm putting the finishing touches on the new version, and hope to have an early preview in a few days.

Nice job with the batch file. I believe doing the redirecting at the batch file invocation would work as well.

poisync myfile.txt >Download.log 2>&1

I think will do redirect the output for both the default and override, but would not open the log in notepad.

What I struggle with is how this tool will be used. It was written so it can easily be added to a scheduler. The new UI is for interactive use where someone can bring up the list, manage the list, and download a set of files. I may update the program so it is a mixture of the two, where if can be scheduled but will display the result graphically.

JCA,

You are correct. The override section is to use a control file that is not named poiFiles.txt. So it only controls which control file you want to use, and it does not affect the type of output you would get.

JCA & Shumans,

I tried your suggestions of adding redirection at the override section and at the batch file invocation without success. If you made those changes and they work, please post the complete batch file.

Thanks,
Jake88

Hi Jake88,

Are you starting PoiSync with an optional control file ("poisync" or "poisync mydownloads.txt")? If you're not using the second format when you're invoking poisync, the override section does not come into play. If you are, it should work just the same as the default, just use a different file.

To clarify, if you're using the default poiFiles.txt control file, you should not need to update the override section since that section does not come into play. If you're specifying a control file other than poiFiles.txt, and did not modify the override section, then your log file should not contain anything.

Hopefully I understood your initial question, and my explanation makes sense.

Shumans,

I use the poifiles.txt file.
As I understand your explanation, if I am not using the "poifiles.txt" file, but want to rename it to "mydownloads.txt", the override section should look like this:

:override
date /t>mydownloads.txt>Download.log 2>&1
time /t>>mydownloads.txt>>Download.log 2>&1
java -jar .\lib\poisync.jar mydownloads.txt>>Download.log 2>&1
goto end

Close. I believe the following would work for you:

:override
date /t >Download.log 2>&1
time /t >Download.log 2>&1
java -jar .\lib\poisync.jar %1 >Download.log 2>&1
goto end

and then invoke poisync like this:

poisync mydownloads.txt

this way, you can have multiple download control files, and specify the one you want when you invoke it, like:

poisync weekly.txt
poisync monthly.txt

Although I think it might be easier if you leave poisync.bat as it was shipped, and then create a batch file that does either this:

poisync >Download.log 2>&1
notepad Download.log

or if you want to override the default control fi;e:

poisync mydownloads.txt >Download.log 2>&1
notepad Download.log

and simply invoke this new batch file (name the file .bat, mypoisync.bat for example):

mypoisync

should be all you need to do. Either way would work, my only concern with editing poisync.bat is that the poisync distribution contains poisync.bat, and you may overwrite your changes when installing a new version. Also, if you don't overwrite it, and I provide a newer version, things may not work right in the future...

Shumans,

Thanks for your help and the explanation. I'll keep a backup copy of the changes for future use.

Works in linux just fine!!

I believe the following would not have the date and time included:
:override
date /t >Download.log 2>&1
time /t >Download.log 2>&1
java -jar .\lib\poisync.jar %1 >Download.log 2>&1
goto end

You need to use >> to append the date and time like:
:override
date /t >Download.log 2>&1
time /t >>Download.log 2>&1
java -jar .\lib\poisync.jar %1 >>Download.log 2>&1
goto end

Yep. My bad. You are correct, the file would be overwritten with each redirect if the append is not used.

I don't understand what the "2>&1" at the end of several commands is supposed to do. It seems to me that it wlll be ignored.

Belay that - I looked it up and found that it "redirects both standard output and standard error of command to file (OS/2 and NT)"

That was not available when I was doing batch files back in the DOS 5.0 and 6.22 days.

Schuman,
I like the user interface.

Observation 1
Have utility ask for username and password or my login before proceeding with any process.

Observation 2
I found when browsing for url's to add to download screen it only selects one address. Is it possible to select multiple addresses?

Observation 3
Allowing multiple url's to be selected, it might be better to pull in the original file name to download window, then allow user to rename file names as desired.

Observation 4
Have utility open to last run or saved download list, and allow user to add or remove as wanted.

Observation 5
PoiSync 2.0 didn't allow user to select target locations.

Keep up the great work.
Phil

1. Yes, I thought about that as well. I debated with not prompting for login unless it is necessary. However, since this is a POI Factory utility, it makes sense to have it always login.

2. If it allows multiple select from the list, do we assume they all go to the same directory, or would you specify each destination directory?

3. This is a good idea, if we can assume a certain directory. Any ideas?

4. Again, good idea. I think a recent file list or something like that would work?

5. Not sure if I understand. Did I break an existing behavior or are you talking about something else?

For everyone not on the 2.0 preview list, if you're interested in trying out the new version, and can live without documentation, can live with bugs, and based on the discussion above, can live with design and interface changes, let me kwow.

It's not Official release. It's the efforts of Jon (My Favorite Files & more..) & Schumans. This version is intended for your feedback to help the Authors to improve a final version.

Please post all your concerns here.

File can be downloaded from following sites.

Doesn't matter which site you choose, it's the same file of course.

http://www.sendspace.com/file/qenztk

http://www.megaupload.com/?d=CNNWJ1VF

http://uploading.com/files/f498a447/PoiSync%2B2.0.0.pre-2010...

The file is FREE of Virus and Malware.

Hi phillyguy,

For the download, it should have downloaded to where ever the entry specified. The message should have also stated where the downloaded file is stored. Can you verify if the files are downloaded to where it says it is?

thanks,

After running my poifile.txt today I discovered redlight and speed camera files failed to download. The problem was due to poi-factory changing the name of the file in the linked address. The download was successful after replacing old linked address (bad file name) with new linked address (good file name).

Old
http://www.poi-factory.com/images/csv/4nu-enforcement-camera...

New
http://www.poi-factory.com/images/csv/3qn-enforcement-camera...

Is there a way to write the linked address to except future file name changes.

ZENHIKER.. The picture is a HOOT.. The utility is pretty good.. Looking fwd to using it..

I took a look, and without a site index, it is difficult to validate the URLs. I could parse the page, but if the page layout changes, the parsing could fail.

Is this a frequent occurance that the URL changes? If that happens frequently, then the risk of parsing the page may be acceptable.

I would think every time the file is updated Miss POI changes the file name to code the current file. We need a way to wild card the first 3-4 characters or entire file name.

I was playing with DOS wildcards ? and * but was unable to figure out how to get it to run, I would receive failure codes 403 or 404.

Yea, wild card would not work for the URL. The response code of 404 is a HTTP response code from POI Factory for not found. A 403 response code is "forbidden", so what ever you tried, you stumbled onto something you're not permitted to access.

I'll have to add some sort of macro for this then, and parse the red light cameras page for the current URL during the download. If the page layout changes, I'll have to put out a version to match.

I'll get that in as part of 2.0.

Let me know when these changes are in so that I can test your 2.0 version

To PJGMIG, THANKS! Found the pic on Internet a long time ago.

Glad to see all the activity on this utility. I looked at it early on and liked it even then! Great work.

Great utility.

Thanks!!

I'm ready to run a short beta before making 2.0 available. Contact me if you're interested in trying out the beta.

Schuman
2.0 beta works really well, there is a minor problem with file save-as and another canceling download in progress. It would be better to allow add link UI to maximize because it is annoying to select files on such small viewing area. Found a good short cut for building download file text. Will discuss more after running it further.
Thanks
Phil

Hi Phil,

All the windows and dialogs that have a table should be fully resizable. The tables will resize as you resize the dialog. All the columns in the tables should be resizable and sortable as well.

I'll see if I can add something so the dialogs will remember the size so once you get it to the right size, it'll remember the next time.

Hi everyone,

Version 2.0 is now available for download at:

http://www.nextgenlogic.com/poi.php

The major change is the new user interface for managing the control files.

Thanks to everyone that helped with the beta!

Schuman
I know how to setup PoiSync 2.0 (non UI version) to run with mylogin.txt and poifile.txt of my choice.

How to I setup PoiSyncUI 2.0 (UI version) to run with mylogin.txt and poifile.txt of my choice?

thanks

Hi Phil,

Right now, the UI does not take any command line paramters. So there is not a way to specify the credentials to use or the default file to open.

I'm thinking of doing something like the browser where you can choose to save the login info after a successful login. This should replace the need for the login text file.

The control file currently is opened with File->Open menu item, and once it has been opened once, can be found in the recent file list and opened that way.

Are you looking for a way to have that file opened automatically?

Schuman,
I understand the UI File>open and Recent File menus. No, this wasn't my question.

Regarding UI opening last file or not, isn't really needed. At least I don't have an interest in having that.

I just though the UI was going to replace the bat file functionality allowing setup scheduling of UI download with auto-login. I can use the bat file, not a big deal for me here either.

I really like both utilities, Thanks
Phil

How do I write text into poifiles.txt to move bmp's and mp3's from a saved location (safe location) to the poi folders at the same time I run PoiSync download.

"[RLC] C:\MyPOIs\Garmin\Temp\"
"file:///C:\MyPOIs\Garmin\Temp\\Redlight-Beta.csv C:\MyPOIs\Garmin\Cameras - Redlight Beta.csv"
"file:///C:\MyPOIs\Garmin\Temp\\Redlight-Cameras.csv C:\MyPOIs\Garmin\Cameras - Redlight.csv"
"file:///C:\MyPOIs\Garmin\Temp\\Speed-Cameras.csv C:\MyPOIs\Garmin\Cameras - Speed.csv"

I've tried adding this next line after above lines.

"file:///C:\MyPOIs\Garmin\Temp\\Redlight-Beta.bmp C:\MyPOIs\Garmin\Cameras - Redlight Beta.bmp"
"file:///C:\MyPOIs\Garmin\Temp\\Redlight-Beta.mp3 C:\MyPOIs\Garmin\Cameras - Redlight Beta.mp3"

I don't get a copy in the move to folder.