salt-minion test needs fixing

Bug #1778737 reported by Scott Moser
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
cloud-init
Fix Released
Undecided
Unassigned

Bug Description

cloud-init-integration-lxd-b test 200 failed.
Looking at the console log at [1] shows
boot instance encountered error: ssh: after 120s instance is not reachable
at 2018年06月26日 11:23:47,693 which was indeed 120 seconds after starting the
salt minion test.

The summary of the failure is just that salt failed to restart due to dns
lookup problems of a host 'salt'.

The corresponding cloud-init log [2] progresses well until

2018年06月26日 11:22:16,726 - util.py[DEBUG]: Running command ['service', 'salt-minion', 'restart'] with allowed return codes [0] (shell=False, capture=False)
2018年06月26日 11:23:47,032 - handlers.py[DEBUG]: finish: modules-final/config-salt-minion: SUCCESS: config-salt-minion ran successfully

So 'service salt-minion restart' took ~ 90 seconds.
$ journalctl --file=system.journal --unit=salt-minion.service | pastebinit
http://paste.ubuntu.com/p/jjkrs3nhYF/

Lines of most interest there are 3 times:
Jun 26 07:22:17 [1241]: [ERROR ] DNS lookup or connection check of 'salt' failed.
Jun 26 07:22:17 [1241]: [ERROR ] Master hostname: 'salt' not found or not responsive. Retrying in 30 seconds

[1] https://jenkins.ubuntu.com/server/job/cloud-init-integration-lxd-b/200/consoleFull
[2] https://jenkins.ubuntu.com/server/job/cloud-init-integration-lxd-b/200/artifact/cloud-init/results/lxd/bionic/modules/salt_minion/cloud-init.log

Related branches

~chad.smith/cloud-init:ubuntu/xenial
Server Team CI bot: Approve (continuous-integration)
Scott Moser: Pending requested
Diff: 1095 lines (+657/-91)
20 files modified
cloudinit/config/cc_bootcmd.py (+7/-1)
cloudinit/config/cc_runcmd.py (+5/-0)
cloudinit/config/cc_write_files.py (+6/-1)
cloudinit/event.py (+17/-0)
cloudinit/gpg.py (+42/-10)
cloudinit/sources/__init__.py (+77/-1)
cloudinit/sources/tests/test_init.py (+82/-1)
cloudinit/stages.py (+10/-4)
cloudinit/tests/test_gpg.py (+54/-0)
cloudinit/tests/test_stages.py (+231/-0)
cloudinit/tests/test_util.py (+68/-1)
cloudinit/util.py (+18/-10)
debian/changelog (+17/-0)
dev/null (+0/-49)
doc/examples/cloud-config-run-cmds.txt (+4/-1)
doc/examples/cloud-config.txt (+4/-1)
doc/rtd/topics/format.rst (+1/-1)
integration-requirements.txt (+1/-1)
tests/unittests/test_datasource/test_azure_helper.py (+3/-1)
tools/run-container (+10/-8)
api
~chad.smith/cloud-init:ubuntu/artful
Server Team CI bot: Approve (continuous-integration)
Scott Moser: Pending requested
Diff: 1095 lines (+657/-91)
20 files modified
cloudinit/config/cc_bootcmd.py (+7/-1)
cloudinit/config/cc_runcmd.py (+5/-0)
cloudinit/config/cc_write_files.py (+6/-1)
cloudinit/event.py (+17/-0)
cloudinit/gpg.py (+42/-10)
cloudinit/sources/__init__.py (+77/-1)
cloudinit/sources/tests/test_init.py (+82/-1)
cloudinit/stages.py (+10/-4)
cloudinit/tests/test_gpg.py (+54/-0)
cloudinit/tests/test_stages.py (+231/-0)
cloudinit/tests/test_util.py (+68/-1)
cloudinit/util.py (+18/-10)
debian/changelog (+17/-0)
dev/null (+0/-49)
doc/examples/cloud-config-run-cmds.txt (+4/-1)
doc/examples/cloud-config.txt (+4/-1)
doc/rtd/topics/format.rst (+1/-1)
integration-requirements.txt (+1/-1)
tests/unittests/test_datasource/test_azure_helper.py (+3/-1)
tools/run-container (+10/-8)
api
~chad.smith/cloud-init:ubuntu/bionic
Server Team CI bot: Approve (continuous-integration)
Scott Moser: Pending requested
Diff: 1095 lines (+657/-91)
20 files modified
cloudinit/config/cc_bootcmd.py (+7/-1)
cloudinit/config/cc_runcmd.py (+5/-0)
cloudinit/config/cc_write_files.py (+6/-1)
cloudinit/event.py (+17/-0)
cloudinit/gpg.py (+42/-10)
cloudinit/sources/__init__.py (+77/-1)
cloudinit/sources/tests/test_init.py (+82/-1)
cloudinit/stages.py (+10/-4)
cloudinit/tests/test_gpg.py (+54/-0)
cloudinit/tests/test_stages.py (+231/-0)
cloudinit/tests/test_util.py (+68/-1)
cloudinit/util.py (+18/-10)
debian/changelog (+17/-0)
dev/null (+0/-49)
doc/examples/cloud-config-run-cmds.txt (+4/-1)
doc/examples/cloud-config.txt (+4/-1)
doc/rtd/topics/format.rst (+1/-1)
integration-requirements.txt (+1/-1)
tests/unittests/test_datasource/test_azure_helper.py (+3/-1)
tools/run-container (+10/-8)
api
~chad.smith/cloud-init:ubuntu/devel
Server Team CI bot: Approve (continuous-integration)
Scott Moser: Pending requested
Diff: 1094 lines (+656/-91)
20 files modified
cloudinit/config/cc_bootcmd.py (+7/-1)
cloudinit/config/cc_runcmd.py (+5/-0)
cloudinit/config/cc_write_files.py (+6/-1)
cloudinit/event.py (+17/-0)
cloudinit/gpg.py (+42/-10)
cloudinit/sources/__init__.py (+77/-1)
cloudinit/sources/tests/test_init.py (+82/-1)
cloudinit/stages.py (+10/-4)
cloudinit/tests/test_gpg.py (+54/-0)
cloudinit/tests/test_stages.py (+231/-0)
cloudinit/tests/test_util.py (+68/-1)
cloudinit/util.py (+18/-10)
debian/changelog (+16/-0)
dev/null (+0/-49)
doc/examples/cloud-config-run-cmds.txt (+4/-1)
doc/examples/cloud-config.txt (+4/-1)
doc/rtd/topics/format.rst (+1/-1)
integration-requirements.txt (+1/-1)
tests/unittests/test_datasource/test_azure_helper.py (+3/-1)
tools/run-container (+10/-8)
api
~smoser/cloud-init:fix/1778737-drop-integration-test
Server Team CI bot: Approve (continuous-integration)
Chad Smith: Approve
Diff: 99 lines (+0/-49)
1 file modified
dev/null (+0/-49)
api
Revision history for this message
Scott Moser (smoser) wrote :

Interesting, this does not seem to always fail.
Here is a
journalctl --file=log2 --unit=salt-minion.service
http://paste.ubuntu.com/p/wkBVJtW586/

from a run of the same test on the day before (build 199).
https://jenkins.ubuntu.com/server/job/cloud-init-integration-lxd-b/199/artifact/cloud-init/results/lxd/bionic/modules/

Revision history for this message
Scott Moser (smoser) wrote :

Wow, heres another error log of a passing (cloud-init-intergration-lxd-b/202)
$ journalctl --file=passed.journal --unit=salt-minion.service | pastebinit
http://paste.ubuntu.com/p/WYRPkfvVDH/

I really am kind of thinking this is a salt-minion issue at this point.

this is at best strange behavior out of the gate for 'apt-get install salt-minion'.

Revision history for this message
Scott Moser (smoser) wrote :

This bug is fixed with commit 58581362 to cloud-init on branch master.

To view that commit see the following URL:
https://git.launchpad.net/cloud-init/commit/?id=58581362

Changed in cloud-init:
status: New → Fix Committed
Revision history for this message

This bug is believed to be fixed in cloud-init in version 18.4. If this is still a problem for you, please make a comment and set the state back to New

Thank you.

Changed in cloud-init:
status: Fix Committed → Fix Released
Revision history for this message
James Falcon (falcojr) wrote :
To post a comment you must log in.
This report contains Public information
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.

AltStyle によって変換されたページ (->オリジナル) /