Code Issues 9 Pull requests 2 Releases 204 Activity

Download OSM objects of an area via Overpass and validate their links https://osm.strubbl.de/olv/

link-checker openstreetmap quality-assurance strubblolv

627 commits 4 branches 209 tags 2.4 MiB

Go 74.3%
CSS 20.5%
JavaScript 5.2%

Find a file

strubbl 9868af2636 Merge pull request 'Translations update from Codeberg Translate' ( #54 ) from translation-updates into main Reviewed-on: #54 Reviewed-by: strubbl <strubbl@noreply.codeberg.org>		2026年03月05日 17:22:03 +01:00
.gitea/workflows	add gitea action	2023年09月25日 22:17:13 +02:00
tmpl	Translated using Weblate (Ukrainian)	2026年03月04日 16:29:10 +00:00
.gitignore	validate config and write that result back to disk	2024年01月26日 22:42:46 +01:00
.goreleaser.yaml	update goreleaser config	2025年01月29日 20:02:46 +01:00
configuration.go	refactor all constants into one go file	2025年10月03日 14:20:25 +02:00
constants.go	try calling overpass api three times with a sleep of 180 sec in between	2026年01月16日 15:32:24 +01:00
copy.go	fix bug where file mode is taken over from embedded fs, which is always read-only	2024年04月22日 23:22:36 +02:00
data-cache.go	improve log messages	2025年03月07日 13:11:16 +01:00
flags.go	refactor all constants into one go file	2025年10月03日 14:20:25 +02:00
go.mod	update to go 1.21 in go.mod	2024年01月27日 19:45:12 +01:00
go.sum	add goreleaser support	2022年08月26日 23:07:41 +02:00
html.go	refactor all constants into one go file	2025年10月03日 14:20:25 +02:00
ignorelist.json	update ignore list	2025年10月25日 22:35:38 +02:00
LICENSE	Initial commit	2022年08月24日 17:18:00 +02:00
main.go	refactor all constants into one go file	2025年10月03日 14:20:25 +02:00
overpass-types.go	introduce status 924 to highlight disused POIs	2024年10月29日 21:18:54 +01:00
overpass.go	cache overpass API result only in case of status code 200	2026年01月17日 12:34:19 +01:00
README.md	update readme	2024年06月11日 20:08:08 +02:00
statistics.go	adjust log levels	2022年12月01日 19:47:29 +01:00
types.go	show email if it's tagged in POIs w/o URL page	2024年06月01日 22:29:15 +02:00
validate.go	ignore 301 redirects for a whole domain	2025年10月11日 17:00:09 +02:00
validate_test.go	ignore a trailing slash for URLs in ignore list	2023年09月14日 23:19:04 +02:00

README.md

OSM-Link-Validator

Übersetzungsstatus

Description

This software downloads OSM objects of an area via Overpass API and validates their links. Several HTML pages are generated, e.g. one with a table showing all the links, which have had a problem. A problem with a link is detected in case it does not respond with HTTP status 200, contains a tracking parameter or should use a different, more specialized OSM key. A map view of that analysis is also available.

Example

An example of the result of this program for Munich can be found at https://osm.strubbl.de/olv/minga.html. The duration for creating this website with OSM-Link-Validator is about 4 hours.

Dependencies

The software dependends on the Overpass API and an online connection of the machine running it.

This software has dependencies to JavaScript and CSS libraries:

Explanations to the page

Table

Sort

The columns are sortable. You can sort a column by clicking on the column headline in the table header at the top.

Column Description

ID: This is the known ID of an OpenStreetMap object. It is linked to OpenStreetMap.org.
Name: The column name contains the name of the object. If the object has no name, but an operator set, the operator is displayed. Otherwise it is empty.
Tag Type: The tag type column displays which key contains the URL.
URL: This is the URL tagged at the OpenStreetMap object at the time of querying the Overpass API.
Status: The column status displays the HTTP status of the website or the error message, which is received when the website is unavailable.
Analysis: This column shows the redirect URL, which was the last location after all redirects. It is only shown, when it is different to the URL in the column URL. The column also list other problems with the URL.
Edit Links: This column has links to directly edit the corresponding OpenStreetMap object in the iD or JOSM editor. It also sets a default comment and a hashtag when using one of these editor links.

Clicking the edit links does not automatically change the OSM object in any editor. It is your responsibility to check the website and the OSM object and to do the needful change if any.

How to use this software

Install

Starting with Release 1.2.0 you can download the binaries for different OS and architectures. Only the Linux 64 Bit version is regularly tested. The other combinations of OS and architecture are untested.

The latest release can be found at: https://codeberg.org/strubbl/osm-link-validator/releases

Download and extract the archive.

Run osm-link-validator

You can run the program e.g. by starting it like this:

$ cd osm-link-validator_7.2.3_Linux_x86_64
$ ./osm-link-validator -rel 62428

If you do not want to use a relation ID, the other possibility is to give the area parameter, which shall be an Overpass area ID. You can find out more about this special ID if you issue the help command:

$ ./osm-link-validator -h
Usage of ./osm-link-validator:
 -area int
 	Overpass API area ID as documented in https://wiki.openstreetmap.org/wiki/Overpass_API/Language_Guide#Area_clauses_(%22area_filters%22). Usually this is the relation ID plus 3600000000 or the way ID plus 2400000000, e.g. Munich relation ID is 62428 and thus the search area ID is 3600062428.
 	If no search area ID is given, the default ID 3601438081, representing Altefähr, is used. (default 3601438081)
 -config string
 	path to your config.json file (default "config.json")
 -d	print debug output
 -dd
 	like parameter -d, but print more debug output
 -ddd
 	like parameter -dd, but print even more debug output
 -rel int
 	Relation ID of the OSM object. This parameter is preferred compared to -area, e.g. when both parameters are given.
 -v	print the program's version

In the description of the area parameter you can learn how to get an ID for the area you want to analyze.

Hint: Do not select a very large area. Otherwise you might hit the quotas of Overpass. E.g., for Munich the resulting Overpass JSON file is about 25 MB. The analysis of this data needs approx. one hour.

Get the result

After running the osm-link-validator, you get the output/ folder. The main HTML pages are created:

$ ls -lh output/*62428.html output/*62428.json
-rw-r--r-- 1 strubbl strubbl 6.2K Feb 11 07:13 output/about-3600062428.html
-rw-r--r-- 1 strubbl strubbl 92K Feb 11 07:13 output/chart-3600062428.html
-rw-r--r-- 1 strubbl strubbl 547K Feb 11 07:13 output/map-3600062428.html
-rw-r--r-- 1 strubbl strubbl 571K Feb 11 07:13 output/pois-no-url-3600062428.html
-rw-r--r-- 1 strubbl strubbl 250K Feb 11 07:13 output/statistics-3600062428.json
-rw-r--r-- 1 strubbl strubbl 534K Feb 11 07:13 output/table-3600062428.html

The resulting HTML page with the long table of findings is the file table-3600374275.html in the subfolder output/, which you can view with a browser, e.g. Firefox. The statistics-3600374275.json collects statistics about the daily status codes of all faulty URLs. They are visualized in the chart page. The map HTML page visualizes the analysis results on a map.