Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings

RAM requirement high even after osmium tags-filter #6811

Unanswered
RemyNtshaykolo asked this question in Q&A
Discussion options

Hi,

I'm trying to implement waterway routing over the world.

I used osmium tags-filter --progress -v -o data-filtered.osm.pbf planet.osm.pbf 'nw/waterway' --overwrite
The output file data-filtered.osm.pbf is 7Gb.

I tried to run the command osrm-extract with a custom .lua profil on EC2 with the following configuration:

  • t3a.2xlarge (32 Gb RAM) : Memory overflow
  • f1.2xlarge (122Gb RAM) : Memory overflow
  • r4.8xlarge (244 Gb RAM ) : Working fine

I am a bit surprised. I thought the thumb rule to run the osrm-extract command was to have around file_size*5=7*5=35 GbRAM in order to run the command. I used (as you can the on the image bellow of the EC2 RAM percentage utilization) up to 50% of the 244 Gb of RAM available, so around 122 Gb to run osrm-extract for A 7Gb file.

  • Is it a normal behaviour?
  • Does osmium tags-filter can help reducing osrm-extract time ?
image
You must be logged in to vote

Replies: 0 comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
1 participant
Converted from issue

This discussion was converted from issue #6738 on March 04, 2024 23:24.

AltStyle によって変換されたページ (->オリジナル) /