Update planet using Osmosis during redaction period

Lambertus · 2012-06-05 23:01:08

During the redaction period which started at April 1st only one planet dump has been made available and the usual daily changeset publication has stopped as well.

I would like to keep a local planet up to date using Osmosis and daily changesets but don't know how to configure Osmosis to use the redaction period changesets.

Anyone have tips how to do this?

stephan75 · 2012-06-06 12:22:42

Unfortunately only in German language, but here http://forum.openstreetmap.org/viewtopic.php?id=14997 seem to be some questions and answers you are looking for.

Does this help?

Lambertus · 2012-06-14 11:22:34

This is what I've done:

./osmupdate32
--verbose
--daily
--max-merge=14
--planet-url=http://planet.openstreetmap.org/redaction-period/
~/planet.openstreetmap.org/planet-120508.osm.pbf
2012-05-07T23:30:00Z
~/planet.openstreetmap.org/planet-20120612.osm.pbf

When I run the resulting planet through Splitter (a Mkgmap companion application) the result is only 95 tiles that are incomplete (~1.8 GB) while I expect about 1800 tiles (~30 GB).
Using a planet created by osmupdate the first splitted tile contains: 657.265 nodes, 62.385 ways, 571 relations.
Using the latest official planet the first splitted tile contains 1.292.878 nodes, 120.402 ways, 2.531 relations.

Apparently osmupdate does not create a valid enough planet that Splitter can handle properly.

Therefore I would like to use Osmosis again as I have without problems before the freeze in normal changeset publications on April 1st. So the question is: does anyone know how to use Osmosis in combination with the redaction changesets?

Below is the Splitter command:
java -Xmx3000m -ea -jar ~/garmin/utils/splitter/splitter.jar
--output=xml
--no-trim
--mapid=63240001
--max-nodes=1200000
--write-kml=initial.kml
--geonames-file=~/garmin/utils/cities15000.zip
~/planet.openstreetmap.org/planet-latest.osm.pbf

Marqqs · 2012-06-14 20:39:52

Lambertus wrote:

This is what I've done:
./osmupdate32
--verbose
--daily
--max-merge=14
--planet-url=http://planet.openstreetmap.org/redaction-period/
~/planet.openstreetmap.org/planet-120508.osm.pbf
2012-05-07T23:30:00Z
~/planet.openstreetmap.org/planet-20120612.osm.pbf

Hi Lambertus!

A few days ago another user had problems with the planet "120508". We found out that his version was corrupted. Please check this file, e.g. via
./osmconvert ~/planet.openstreetmap.org/planet-120508.osm.pbf --out-statistics

Please ensure to have the newest versions of osmconvert and osmupdate.

Markus

Lambertus · 2012-06-14 22:25:52

I downloaded the osmconvert and osmupdate utilities on the 4th of June, those are the latest versions? The 32bit Linux version of Osmupdate/convert are used on 64bit Linux (there is no 64bit version available), this should not cause problems?

The planet 120508 is fine for splitter. I also have the same problem for the 120401 planet which splitter handles normally. Whatever source planet file I'm using, it is the result from osmupdate that does not parse well with Splitter.

But I'll post the osmconvert statistics later.

Lambertus · 2012-06-15 11:24:42

Original planet 2012-05-08 (parsed OK by Splitter):

./osmconvert --out-statistics planet-120508.osm.pbf
timestamp min: 2005-05-01T14:56:35Z
timestamp max: 2012-05-08T11:24:38Z
lon min: -180.0000000
lon max: 180.0000000
lat min: -90.0000000
lat max: 90.0000000
nodes: 1451697049
ways: 135258238
relations: 1401266
node id min: 1
node id max: 1745404857
way id min: 35
way id max: 162688056
relation id min: 11
relation id max: 2175120
keyval pairs max: 338
noderefs max: 2000
relrefs max: 10293

Updated planet 2012-05-08 using osmupdate (parsed incorrectly by Splitter):

./osmconvert --out-statistics planet-20120612.osm.pbf
timestamp min: 2005-05-01T14:56:35Z
timestamp max: 2012-06-12T00:00:00Z
lon min: -180.0000000
lon max: 180.0000000
lat min: -90.0000000
lat max: 90.0000000
nodes: 1484059278
ways: 138912881
relations: 1442162
node id min: 3
node id max: 1784134391
way id min: 35
way id max: 167016094
relation id min: 11
relation id max: 2226631
keyval pairs max: 338
noderefs max: 2000
relrefs max: 10293

Original planet 2012-04-01 (parsed OK by Splitter):

./osmconvert --out-statistics planet-120401.osm.pbf
osmconvert Warning: way 29052748 user string index overflow: 5390>=4899
timestamp min: 2005-05-01T14:56:35Z
timestamp max: 2012-04-01T08:03:04Z
lon min: -180.0000000
lon max: 180.0000000
lat min: -90.0000000
lat max: 90.0000000
nodes: 1415865974
ways: 131260862
relations: 1355079
node id min: 1
node id max: 1700644120
way id min: 35
way id max: 157812525
relation id min: 11
relation id max: 2110237
keyval pairs max: 338
noderefs max: 2000
relrefs max: 10293

Lambertus · 2012-06-15 18:31:28

Finally managed to update the latest official planet (2012-05-08) using Osmosis. Resulting planet is smaller (no meta info) that the original. Osmconvert results:

./osmconvert --out-statistics planet-20120615.osm.pbf
lon min: -180.0000000
lon max: 180.0000000
lat min: -90.0000000
lat max: 90.0000000
nodes: 1463113068
ways: 136606479
relations: 1412546
node id min: 1
node id max: 1759071468
way id min: 35
way id max: 164256793
relation id min: 11
relation id max: 2191210
keyval pairs max: 338
noderefs max: 2000
relrefs max: 10293

Let's see what Splitter thinks of it...

Lambertus · 2012-06-16 16:27:37

Lambertus wrote:

Let's see what Splitter thinks of it...

The planet updated with Osmosis is processed fine by Splitter. So it seems that osmupdate produces a planet in PBF format that is incompatible with Splitter.

Marqqs · 2012-06-21 22:59:39

Lambertus wrote:

The planet updated with Osmosis is processed fine by Splitter. So it seems that osmupdate produces a planet in PBF format that is incompatible with Splitter.

That's really unfortune.
Did you open a ticket for Splitter? There might be an error in Splitter's PBF parser....

OpenStreetMap Forum

#1 2012-06-05 23:01:08

Update planet using Osmosis during redaction period

#2 2012-06-06 12:22:42

Re: Update planet using Osmosis during redaction period

#3 2012-06-14 11:22:34

Re: Update planet using Osmosis during redaction period

#4 2012-06-14 20:39:52

Re: Update planet using Osmosis during redaction period

#5 2012-06-14 22:25:52

Re: Update planet using Osmosis during redaction period

#6 2012-06-15 11:24:42

Re: Update planet using Osmosis during redaction period

#7 2012-06-15 18:31:28

Re: Update planet using Osmosis during redaction period

#8 2012-06-16 16:27:37

Re: Update planet using Osmosis during redaction period

#9 2012-06-21 22:59:39

Re: Update planet using Osmosis during redaction period

Board footer