Worldwide routable Garmin maps: URL REMOVED

Beerforfree · April 13, 2011, 4:14pm

Lambertus when does it come the next update of maps in the page?
Seems that there may be some troubles, last update is from March 7th. Take it easy no intention to pressure you ha ha ha

Lambertus · April 14, 2011, 7:51am

Thanks Ligfietser, I was too lazy to search for an example

Well, the pressure was already on…my laptop

Seriously now, two points:

For a few months I’ve had the luxury of the availability of a fast server (without fast internet though) that I could use to preprocess new map versions for a while, but no more unfortunately. That means I have to do the preprocessing on my laptop again which takes a veeerrryyyy long time (about three full days), during which I hardly can use the laptop due to the load.
The server that generates the user-requested maps is slow and has limited disk space, it cannot keep up with demand unless the caching strategy is in full effect. Due to various queues and delays the caching strategy becomes effective after about 1.5 to two weeks after a new update. By then the queue is so long that it takes another two weeks to get back to acceptable levels. This limits the update interval to at least three weeks currently, at least four weeks when you/I want to enjoy the caching benefits.

Point 1 is almost solved as I’ve ordered a new workstation, Point 2 is being worked on in two ways: I’ve asked my sponsor to provide a better server (but unfortunately my contact person is unavailable for a few weeks more) and someone offered me a server, however progress is somehow slow on that front (dunno why).

So, please be patient for a few days more while the new version is generated and uploaded.

Meanwhile I moved the webfrontend to a new webhost (courtesy of Oxilion again!) because the routable Garmin webpage used all of the allowed traffic on my na1400.info domain. So the new URL for the routable Garmin maps is: http://garmin.openstreetmap.nl

AlexandrosPapadopoulos · April 15, 2011, 3:11pm

I guess writing a distributed client that uses BOINC ( http://boinc.berkeley.edu/ ) for map rendering would be too much to ask… as a quick’n’dirty interim solution would you consider replicating your build environment on a VM (with something that provides free players for most platforms, like VMware)? You could then make this VM available to people to download and hopefully do some map rendering.

It’s obviously more complicated than that, but until you get up and running with the new workstation/servers, these are my 2 cents.

PS: I just realised the exact same ideas are documented on http://wiki.openstreetmap.org/wiki/Tiles@home#How_you_can_help

Lambertus · April 15, 2011, 4:48pm

Thanks for your input, but BOINC or VM’s aren’t necessary, a ‘simple’ application that can download tiles and use Mkgmap to build a custom map on the client pc is all that is needed. This has been discussed before and I have plans to start developing that application next winter, although anyone with an interest can contact me for input (or not) and start creating such an application at any time.

Beddhist · April 16, 2011, 8:32am

Is there a problem on the web site? I get this at the top of the page:

Get map definition. (version: 13-04-2011, update: )
Warning: exec() has been disabled for security reasons in /home/garmin/domains/garmin.openstreetmap.nl/public_html/index.php on line 83

Warning: exec() has been disabled for security reasons in /home/garmin/domains/garmin.openstreetmap.nl/public_html/index.php on line 85

Warning: exec() has been disabled for security reasons in /home/garmin/domains/garmin.openstreetmap.nl/public_html/index.php on line 87

Warning: exec() has been disabled for security reasons in /home/garmin/domains/garmin.openstreetmap.nl/public_html/index.php on line 88
Free routable maps for Garmin brand GPS devices

Lambertus · April 16, 2011, 12:02pm

Yep, I noticed that too this morning. I updated the map version but did not check if everything worked as expected (I really should have done that after moving to the new webhost). Anyway, it appears that the webserver is more restricted on this new host. I’m busy working around this and hope to finish this somewhere ~~today~~…

Edit: Sorry, I couldn’t finish it yesterday and today most likely not as well. I’m going to test your patience some more…

Francisco_Moraes · April 18, 2011, 11:47pm

Lambertus:

Download the planet file if you plan to render the entire world, like I do. Otherwise download from a Geofabrik or Cloudemade extract or from any other extract source.

The next two steps are performed recursively until Mkgmap was able to render the source data successfully.

Split the planet into tiles that can be processed by Mkgmap:
java -Xmx3400m -ea -jar ~/garmin/utils/splitter/splitter.jar --no-trim --max-areas=150 --cache=cache --mapid=$mapid --max-nodes=$max_nodes --write-kml=$name.kml --geonames-file=../../cities15000.zip planet-latest.translit.osm.gz

Question: what do you use for $max_nodes and where do you get the $mapid and $name variables?

Thanks.

Lambertus · April 19, 2011, 7:40am

Francisco Moraes:

Lambertus:
Download the planet file if you plan to render the entire world, like I do. Otherwise download from a Geofabrik or Cloudemade extract or from any other extract source.

The next two steps are performed recursively until Mkgmap was able to render the source data successfully.

Split the planet into tiles that can be processed by Mkgmap:
java -Xmx3400m -ea -jar ~/garmin/utils/splitter/splitter.jar --no-trim --max-areas=150 --cache=cache --mapid=$mapid --max-nodes=$max_nodes --write-kml=$name.kml --geonames-file=../../cities15000.zip planet-latest.translit.osm.gz
Question: what do you use for $max_nodes and where do you get the $mapid and $name variables?

Thanks.

$max_nodes = 1200000 in my previous releases and, as a test, 14000000 in the latest which has not been released yet but I needed to reduce the --max-areas to 130 (memory usage is a multiplication of (among others) max-nodes and max-areas, so if you increase max-nodes you need to reduce max-areas otherwise there is a chance java will run out of memory).
$mapid and $name are just ‘constants’ defined at the top of my build script, ‘63240000’ and ‘world’ respectively.

Francisco_Moraes · April 19, 2011, 7:48pm

Lambertus,

Thanks for your reply. I was able to build the map and installed without problem on my Garmin. MapSource is not happy though:

App: MapSource
At: 4/19/2011 7:46:51 PM (UTC)
OS: Windows 7 (64-bit) Service Pack 1
Processor: x86, Processor Level: 6, Processors:2, Model: 23 Stepping: 10, RAM: 4087836
TDB_REGIONDIR.CPP-103-6.16.3.0
Language ID: 1033
Part Number: 006-A0041-00
Build Type: Release

Guess I will have to ask in the mkgmap list.

Joasje · April 19, 2011, 8:01pm

Help, http://garmin.na1400.info/routable.php doet het niet meer! Wat nu, we gaan vrijdag naar Israël!

Lambertus · April 20, 2011, 8:15pm

You can do that ofcourse, although I recently noticed that recent MapSources don’t load the OSM map if it’s the only one installed. Installing two or more maps and selecting the OSM map will show it. Really strange. Perhaps this is your problem? If not, are there any error reports?

Answered earlier via email.

Anyway, I think most of the problems are gone now and I’ll upload a new version of the website any time now. I’m doing a few test renders to see if things seem normal again and then the site will go live again.

Francisco_Moraes · April 20, 2011, 8:25pm

I have other maps installed. This is very strange. If I remove the map I created, it all loads fine. The map generated won’t load at all. I took the OSM data for North Carolina from cloudmade and processed per your posts. The map displays some icons (green circle) that I don’t see on your maps, so I am wondering if you are using any special TYP file?

I will try to report the issue on the mkgmap list later today or tomorrow. One thing I noticed is that newer versions of mkgmap are much faster on rendering. Probably twice as fast, just FYI.

ras_oscar · April 21, 2011, 1:18am

In the past I have downloaded tiles, combined them with with Mkgmap using a script file. Recently I downloaded a group of tiles and the combiner failed, complaining "

C:\Garmin\Maps\OSM_World_Routable>java.exe -Xmx512M -enableassertions -jar c:\Ga
rmin\Map_Tools\MKGMAP\mkgmap.jar --max-jobs --ignore-osm-bounds --route --family
-id=2020 --overview-mapname=53240000 --tdbfile --index --keep-going --drive-on-r
ight --overview-mapnumber=53240000 --family-name=“OSM ras_oscar” c:\Garmin\Maps
OSM_World_Routable*.img
Exception in thread “main” java.lang.IllegalArgumentException
at java.nio.Buffer.position(Unknown Source)
at uk.me.parabola.imgfmt.Utils.bytesToString(Utils.java:75)
at uk.me.parabola.imgfmt.sys.ImgHeader.setHeader(ImgHeader.java:212)
at uk.me.parabola.imgfmt.sys.ImgFS.readInitFS(ImgFS.java:310)
at uk.me.parabola.imgfmt.sys.ImgFS.openFs(ImgFS.java:129)
at uk.me.parabola.imgfmt.sys.ImgFS.openFs(ImgFS.java:122)
at uk.me.parabola.mkgmap.combiners.FileInfo.imgInfo(FileInfo.java:185)
at uk.me.parabola.mkgmap.combiners.FileInfo.getFileInfo(FileInfo.java:14
7)
at uk.me.parabola.mkgmap.main.Main.endOptions(Main.java:366)
at uk.me.parabola.mkgmap.CommandArgsReader.readArgs(CommandArgsReader.ja
va:124)
at uk.me.parabola.mkgmap.main.Main.main(Main.java:122)

Have there been changes to anything in the data structures that would cause this error string? I have not changed either mkgmap or java in well over the year since i used it last.

Beddhist · April 21, 2011, 2:52am

Still works for me, version 1795.

Lambertus · April 21, 2011, 7:20am

The website is updated yesterday and it should work fine again, although I released it in a rush (had to go to bed).

Nope, I’m using the default Mkgmap style and no TYP file.

Faster rendering is nice to have ofcourse, although in the grand scheme of (my) things rendering is not the most time-consuming job. Thanks for the heads-up.

Ras_Oscar: Sorry, I don’t have a clue… Did you download the tiles from my website? And from which version? 13-04-2011 or 07-03-2011?

greencaps · April 21, 2011, 7:46am

Lambertus, the link to the template file world.kml gives a 404. Could you repair it? I like this file

Beddhist · April 21, 2011, 8:38am

Lambertus,

The web site looks ok now, but it’s missing the date of the extract. There is just a ‘1’ there now.

Regards,
Peter.

Lambertus · April 21, 2011, 10:12am

Thanks, both, for the reports.

I’ve updated the link so that it redirects to the current template file. But I must add, that I’m moving away from this file towards the countries.js file which will include the coordinates and tile availability at some point in the future. I’ll probably keep uploading the world.kml file after the migration, but won’t guarantee that unless there are very good reasons to keep supporting that file.

Fixed.

Edit: The past site-outage was a nice test: the 150gb disk was almost empty when the site came online again and was full after exactly 30h.

greencaps · April 23, 2011, 7:32am

That would be all I ask for. The format is not important. Just that somewhere you tell which area is covered by a tile.

Lambertus · April 23, 2011, 9:52am

Cool developments

Ligfietser is going strong with his little TYP file project for the routable maps and I’ll add one of my own:

I’ve been given an offer for another host to store maps on and this offer is much more serious then the offer last month (which doesn’t seem to go anywhere). So it’s time to make some choices: I could use this new opportunity to host maps that include the Ligfietser TYP file (or even any TYP) so that users can choose which map they want and I can get a feeling about using or not using a TYP file by default. Alternatively I could use this host to split country/custom maps between the two servers and hereby greatly reduce the waiting time.

Wishes, suggestions? Input is welcome!