As I said hier https://forum.openstreetmap.org/viewtopic.php?pid=851294 I’m trying to import the data for Europe.
Since with normal HDD after one month the import is already working, I’d try with an SSD.
The question is how big should be the SSD in order to import the data for Europe…
Can someone help me? I have currently an 512GB SSD that I can use. Is it enough or do I need something greater?
The planet pbf currently has 62GB, and the Europe extract 24GB. A full planet import with all tags (–hstore-all) currently needs about 1TB, so half a TB should still be more than enough for just Europe …
(I did all of Europe on a server with 2x240GB SSD, but that was some five years ago. I then switched to whole planet on that machine, using the osm2pgsql feature to put indexes and actual table data on different tablespaces, and only having indexes on SSD, but that was “living on the edge” as that was just barely fast enough to catch up with diffs to keep the DB up to date, taking over 20 hours to import a daily diff back then)
I imported the data on a Test-Server I have in office with SSD.
Total space: 576GB…
So my 512GB SSD is not enough…
You said that it is possible to split the data on more disks. Could you say me how? What are the pros? And what the contras?
Thanks
Luca
P.S.: I really can’t believe… Last year I imported the data of Europe and I’m sure 512GB were enough… Did really the data growed so much?
Since I found the declaration in an HowTo… Now I read the Man-Pages of osm2pgsql…
–slim stores temporary data in the database. Good if I don’t have many RAM (currently the Server I’ll use has 16GB)
But I see a --drop:
So, do I understand correctly, that if I import with --slim --drop I’ll get a reduced disk space after the import?
Is there a possibility to “drop” the temporary data after the import? Just to test it on the Test-Server I used…
Ciao Luca. You’re using --slim, so maybe you can use --flat-nodes and provide a path in a non-SSD location. But probably 500GiB is getting more and more tight, as loads of data is pouring in from apps like StreetComplete. Check all the options in osm2pgsql -h -v, specially the Middle options. I thought there were some options for optimizing the db, but I can’t find them now; they should use extra space at the end of the import.