sru cloud-init (22.3 update) Bionic, Focal, Jammy

Bug Description

== Begin SRU Template ==
[Impact]
This release sports both bug-fixes and new features and we would like to
make sure all of our supported customers have access to these
improvements. The notable ones are:

Config Module Additions / Deletions:
- Ansible config module
- Wireguard config module
- Drop debug module

Behavior changes:
- schema: Resolve user-data if --system given
- mounts: fix suggested_swapsize for > 64GB hosts

New Features:
- clean: add param to remove /etc/machine-id for golden image creation
- Return cc_set_hostname to PER_INSTANCE frequency
- clean: allow third party cleanup scripts in /etc/cloud/clean.d
- ssh_util: Handle sshd_config.d folder

Optimizations:
- meta-schema: add infra to skip inapplicable modules
- main: avoid downloading full contents cmdline urls
- Update WebHookHandler to run as background thread
- net: Implement link-local ephemeral ipv6

New debian/patches context:
- Ensure password expire doesn't apply to hashed users:
This patch sets a feature flag EXPIRE_APPLIES_TO_HASHED_USERS=False to retain original behavior seen on stable releases Bionic, Focal and Jammy. Kinetic and later will expire hashed user passwords by default

See the changelog entry below for a full list of changes and bugs.

[Test Case]
The following development and SRU process was followed:
https://wiki.ubuntu.com/CloudinitUpdates

The cloud-init team will be in charge of attaching the artifacts and
console output of the appropriate run to the bug. cloud-init team
members will not mark ‘verification-done’ until this has happened.

* Automated Test Results
Test results are attached in comments 14-16 below.

[Regression Potential]
In order to mitigate the regression potential, the results of the
aforementioned integration tests are attached to this bug.

[Discussion]

== End SRU Template ==

== Changelog ==
- Fix v2 interface matching when no MAC (LP: #1986551)
- test: reduce number of network dependencies in flaky test (#1702)
- docs: publish cc_ubuntu_autoinstall docs to rtd (#1696)
- net: Fix EphemeraIPNetwork (#1697)
- test: make ansible test work across older versions (#1691)
- Networkd multi-address support/fix (#1685) [Teodor Garzdin]
- make: drop broken targets (#1688)
- net: Passthough v2 netconfigs in netplan systems (#1650)
(LP: #1978543)
- NM ipv6 connection does not work on Azure and Openstack (#1616)
[Emanuele Giuseppe Esposito]
- Fix check_format_tip (#1679)
- DataSourceVMware: fix var use before init (#1674) (LP: #1987005)
[Andrew Kutz]
- rpm/copr: ensure RPM represents new clean.d dir artifacts (#1680)
- test: avoid centos leaked check of /etc/yum.repos.d/epel-testing.repo
(#1676)
- typo correction in Changelog
- sources: obj.pkl cache should be written anyime get_data is run
(#1669)
- schema: drop release number from version file (#1664)
- pycloudlib: bump to quiet azure HTTP info logs (#1668)
- test: fix wireguard integration tests (#1666)
- Github is deprecating the 18.04 runner starting 12.1 (#1665)
- integration tests: Ensure one setup for all tests (#1661)
- tests: ansible test fixes (#1660)
- Prevent concurrency issue in test_webhook_hander.py (#1658)
- Workaround net_setup_link race with udev (#1655) (LP: #1983516)
- test: drop erroneous lxd assertion, verify command succeeded (#1657)
- Workaround net_setup_link race with udev (#1655)
- Prevent concurrency issue in test_webhook_hander.py (#1658)
- tests: ansible test fixes (#1660)
- integration tests: Ensure one setup for all tests (#1661)
- Github is deprecating the 18.04 runner starting 12.1 (#1665)
- test: fix wireguard integration tests (#1666)
- pycloudlib: bump to quiet azure HTTP info logs (#1668)
- schema: drop release number from version file (#1664)
- sources: obj.pkl cache should be written anyime get_data is run (#1669)
- schema: drop release number from version file (#1664)
- pycloudlib: bump to quiet azure HTTP info logs (#1668)
- test: fix wireguard integration tests (#1666)
- Github is deprecating the 18.04 runner starting 12.1 (#1665)
- integration tests: Ensure one setup for all tests (#1661)
- tests: ansible test fixes (#1660)
- Prevent concurrency issue in test_webhook_hander.py (#1658)
- Workaround net_setup_link race with udev (#1655) (LP: #1983516)
- test: drop erroneous lxd assertion, verify command succeeded (#1657)
- Fix Chrony usage on Centos Stream (#1648) [Sven Haardiek] (LP: #1885952)
- sources/azure: handle network unreachable errors for savable PPS (#1642)
[Chris Patterson]
- Return cc_set_hostname to PER_INSTANCE frequency (#1651) (LP: #1983811)
- test: Collect integration test time by default (#1638)
- test: Drop forced package install hack in lxd integration test (#1649)
- schema: Resolve user-data if --system given (#1644)
[Alberto Contreras] (LP: #1983306)
- test: use fake filesystem to avoid file removal (#1647)
[Alberto Contreras]
- tox: Fix tip-flake8 and tip-mypy (#1635) [Alberto Contreras]
- config: Add wireguard config module (#1570) [Fabian Lichtenegger-Lukas]
- tests: can run without azure-cli, tests expect inactive ansible (#1643)
- typing: Type UrlResponse.contents (#1633) [Alberto Contreras]
- testing: fix references to `DEPRECATED.` (#1641) [Alberto Contreras]
- ssh_util: Handle sshd_config.d folder [Alberto Contreras] (LP: #1968873)
- schema: Enable deprecations in cc_update_etc_hosts (#1631)
[Alberto Contreras]
- Add Ansible Config Module (#1579)
- util: Support Idle process state in get_proc_ppid() (#1637)
- schema: Enable deprecations in cc_growpart (#1628) [Alberto Contreras]
- schema: Enable deprecations in cc_users_groups (#1627)
[Alberto Contreras]
- util: Fix error path and parsing in get_proc_ppid()
- main: avoid downloading full contents cmdline urls (#1606)
[Alberto Contreras] (LP: #1937319)
- schema: Enable deprecations in cc_scripts_vendor (#1629)
[Alberto Contreras]
- schema: Enable deprecations in cc_set_passwords (#1630)
[Alberto Contreras]
- sources/azure: add experimental support for preprovisioned os disks
(#1622) [Chris Patterson]
- Remove configobj a_to_u calls (#1632) [Stefano Rivera]
- cc_debug: Drop this module (#1614) [Alberto Contreras]
- schema: add aggregate descriptions in anyOf/oneOf (#1636)
- testing: migrate test_sshutil to pytest (#1617) [Alberto Contreras]
- testing: Fix test_ca_certs integration test (#1626) [Alberto Contreras]
- testing: add support for pycloudlib's pro images (#1604)
[Alberto Contreras]
- testing: migrate test_cc_set_passwords to pytest (#1615)
[Alberto Contreras]
- network: add system_info network activator cloud.cfg overrides (#1619)
(LP: #1958377)
- docs: Align git remotes with uss-tableflip setup (#1624)
[Alberto Contreras]
- testing: cover active config module checks (#1609) [Alberto Contreras]
- lxd: lvm avoid thinpool when kernel module absent
- lxd: enable MTU configuration in cloud-init
- doc: pin doc8 to last passing version
- cc_set_passwords fixes (#1590)
- Modernise importer.py and type ModuleDetails (#1605) [Alberto Contreras]
- config: Def activate_by_schema_keys for t-z (#1613) [Alberto Contreras]
- config: define activate_by_schema_keys for p-r mods (#1611)
[Alberto Contreras]
- clean: add param to remove /etc/machine-id for golden image creation
- config: define `activate_by_schema_keys` for a-f mods (#1608)
[Alberto Contreras]
- config: define activate_by_schema_keys for s mods (#1612)
[Alberto Contreras]
- sources/azure: reorganize tests for network config (#1586)
[Chris Patterson]
- config: Define activate_by_schema_keys for g-n mods (#1610)
[Alberto Contreras]
- meta-schema: add infra to skip inapplicable modules [Alberto Contreras]
- sources/azure: don't set cfg["password"] for default user pw (#1592)
[Chris Patterson]
- schema: activate grub-dpkg deprecations (#1600) [Alberto Contreras]
- docs: clarify user password purposes (#1593)
- cc_lxd: Add btrfs and lvm lxd storage options (SC-1026) (#1585)
- archlinux: Fix distro naming[1] (#1601) [Kristian Klausen]
- cc_ubuntu_autoinstall: support live-installer autoinstall config
- clean: allow third party cleanup scripts in /etc/cloud/clean.d (#1581)
- sources/azure: refactor chassis asset tag handling (#1574)
[Chris Patterson]
- Add "netcho" as contributor (#1591) [Kaloyan Kotlarski]
- testing: drop impish support (#1596) [Alberto Contreras]
- black: fix missed formatting issue which landed in main (#1594)
- bsd: Don't assume that root user is in root group (#1587)
- docs: Fix comment typo regarding use of packages (#1582)
[Peter Mescalchin]
- Update govc command in VMWare walkthrough (#1576) [manioo8]
- Update .github-cla-signers (#1588) [Daniel Mullins]
- Rename the openmandriva user to omv (#1575) [Bernhard Rosenkraenzer]
- sources/azure: increase read-timeout to 60 seconds for wireserver
(#1571) [Chris Patterson]
- Resource leak cleanup (#1556)
- testing: remove appereances of FakeCloud (#1584) [Alberto Contreras]
- Fix expire passwords for hashed passwords (#1577)
[Sadegh Hayeri] (LP: #1979065)
- mounts: fix suggested_swapsize for > 64GB hosts (#1569) [Steven Stallion]
- Update chpasswd schema to deprecate password parsing (#1517)
- tox: Remove entries from default envlist (#1578) (LP: #1980854)
- tests: add test for parsing static dns for existing devices (#1557)
[Jonas Konrad]
- testing: port cc_ubuntu_advantage test to pytest (#1559)
[Alberto Contreras]
- Schema deprecation handling (#1549) [Alberto Contreras]
- Enable pytest to run in parallel (#1568)
- sources/azure: refactor ovf-env.xml parsing (#1550) [Chris Patterson]
- schema: Force stricter validation (#1547)
- ubuntu advantage config: http_proxy, https_proxy (#1512)
[Fabian Lichtenegger-Lukas]
- net: fix interface matching support (#1552) (LP: #1979877)
- Fuzz testing jsonchema (#1499) [Alberto Contreras]
- testing: Wait for changed boot-id in test_status.py (#1548)
- CI: Fix GH pinned-format jobs (#1558) [Alberto Contreras]
- Typo fix (#1560) [Jaime Hablutzel]
- tests: mock dns lookup that causes long timeouts (#1555)
- tox: add unpinned env for do_format and check_format (#1554)
- cc_ssh_import_id: Substitute deprecated warn (#1553) [Alberto Contreras]
- Remove schema errors from log (#1551) (LP: #1978422) (CVE-2022-2084)
- Update WebHookHandler to run as background thread (SC-456) (#1491)
(LP: #1910552)
- testing: Don't run custom cloud dir test on Bionic (#1542)
- bash completion: update schema command (#1543) (LP: #1979547)
- CI: add non-blocking run against the linters tip versions (#1531)
[Paride Legovini]
- Change groups within the users schema to support lists and strings
(#1545) [RedKrieg]
- make it clear which username should go in the contributing doc (#1546)
- Pin setuptools for Travis (SC-1136) (#1540)
- Fix LXD datasource crawl when BOOT enabled (#1537)
- testing: Fix wrong path in dual stack test (#1538)
- cloud-config: honor cloud_dir setting (#1523)
[Alberto Contreras] (LP: #1976564)
- Add python3-debconf to pkg-deps.json Build-Depends (#1535)
[Alberto Contreras]
- redhat spec: udev/rules.d lives under /usr/lib on rhel-based systems
(#1536)
- tests/azure: add test coverage for DisableSshPasswordAuthentication
(#1534) [Chris Patterson]
- summary: Add david-caro to the cla signers (#1527) [David Caro]
- Add support for OpenMandriva (https://openmandriva.org/) (#1520)
[Bernhard Rosenkraenzer]
- tests/azure: refactor ovf creation (#1533) [Chris Patterson]
- Improve DataSourceOVF error reporting when script disabled (#1525) [rong]
- tox: integration-tests-jenkins: softfail if only some test failed
(#1528) [Paride Legovini]
- CI: drop linters from Travis CI (moved to GH Actions) (#1530)
[Paride Legovini]
- sources/azure: remove unused encoding support for customdata (#1526)
[Chris Patterson]
- sources/azure: remove unused metadata captured when parsing ovf (#1524)
[Chris Patterson]
- sources/azure: remove dscfg parsing from ovf-env.xml (#1522)
[Chris Patterson]
- Remove extra space from ec2 dual stack crawl message (#1521)
- tests/azure: use namespaces in generated ovf-env.xml documents (#1519)
[Chris Patterson]
- setup.py: adjust udev/rules default path (#1513)
[Emanuele Giuseppe Esposito]
- Add python3-deconf dependency (#1506) [Alberto Contreras]
- Change match macadress param for network v2 config (#1518)
[Henrique Caricatti Capozzi]
- sources/azure: remove unused userdata property from ovf (#1516)
[Chris Patterson]
- sources/azure: minor refactoring to network config generation (#1497)
[Chris Patterson]
- net: Implement link-local ephemeral ipv6
- Rename function to avoid confusion (#1501)
- Fix cc_phone_home requiring 'tries' (#1500) (LP: #1977952)
- datasources: replace networking functions with stdlib and cloudinit.net
code
- Remove xenial references (#1472) [Alberto Contreras]
- Oracle ds changes (#1474) [Alberto Contreras] (LP: #1967942)
- improve runcmd docs (#1498)
- add 3.11-dev to Travis CI (#1493)
- Only run github actions on pull request (#1496)
- Fix integration test client creation (#1494) [Alberto Contreras]
- tox: add link checker environment, fix links (#1480)
- cc_ubuntu_advantage: Fix doc (#1487) [Alberto Contreras]
- cc_yum_add_repo: Fix repo id canonicalization (#1489)
[Alberto Contreras] (LP: #1975818)
- Add linitio as contributor in the project (#1488) [Kevin Allioli]
- net-convert: use yaml.dump for debugging python NetworkState obj (#1484)
(LP: #1975907)
- test_schema: no relative $ref URLs, replace $ref with local path (#1486)
- cc_set_hostname: do not write "localhost" when no hostname is given
(#1453) [Emanuele Giuseppe Esposito]
- Update .github-cla-signers (#1478) [rong]
- schema: write_files defaults, versions $ref full URL and add vscode
(#1479)
- docs: fix external links, add one more to the list (#1477)
- doc: Document how to change module frequency (#1481)
- tests: bump pycloudlib (#1482)
- tests: bump pycloudlib pinned commit for kinetic Azure (#1476)
- testing: fix test_status.py (#1475)
- integration tests: If KEEP_INSTANCE = True, log IP (#1473)
- Drop mypy excluded files (#1454) [Alberto Contreras]
- Docs additions (#1470)
- Add "formatting tests" to Github Actions
- Remove unused arguments in function signature (#1471)
- Changelog: correct errant classification of LP issues as GH (#1464)
- Use Network-Manager and Netplan as default renderers for RHEL and Fedora
(#1465) [Emanuele Giuseppe Esposito]

An upload of cloud-init to bionic-proposed has been rejected from the upload queue for the following reason: "Missing cloud-init.postinst changes from most recent security upload".

An upload of cloud-init to focal-proposed has been rejected from the upload queue for the following reason: "Missing cloud-init.postinst changes from most recent security upload".

An upload of cloud-init to jammy-proposed has been rejected from the upload queue for the following reason: "Missing cloud-init.postinst changes from most recent security upload".

Please reject the cloud-init SRU unapproved upload 22.3-3-g9f0efc47-0ubuntu1~18.04.1 from 08/26/22. A potential regression was discovered with that release in some network v2 passthrough configs https://bugs.launchpad.net/subiquity/+bug/1986551

The new upload 22.3-13 contains:
- test fixes for intermittent automated test failures in unittests and integration tests
- bug fixes from 22.3-3:
- LP: 1986551: clean passthrough of network version: 2 direct to rendererd /etc/netplan/50-cloud-init.yaml without internal conversion to cloud-init network_state
- LP: #1986551: handle network version: 2 on non-netplan environments where nameserver defenintions do not contain a corresponding match:macaddress declaration

Hello James, or anyone else affected,

Accepted cloud-init into jammy-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/cloud-init/22.3-13-g70ce6442-0ubuntu1~22.04.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-jammy to verification-done-jammy. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-jammy. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

Hello James, or anyone else affected,

Accepted cloud-init into focal-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/cloud-init/22.3-13-g70ce6442-0ubuntu1~20.04.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-focal to verification-done-focal. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-focal. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

Hello James, or anyone else affected,

Accepted cloud-init into bionic-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/cloud-init/22.3-13-g70ce6442-0ubuntu1~18.04.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-bionic to verification-done-bionic. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-bionic. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

Attach file SRU-cloud-init-22.3-13.tar.gz.

This is an analysis of the above test files from jenkins.

Test Infrastructure Failures (currently rerunning):
===================================================
bionic-lxd-vm
focal-lxd-vm

Expected Test Failures:
=======================
tests/integration_tests/modules/test_combined.py::TestCombinedNoCI::test_ssh_import_id

This is a regression in test code, not indicative of an issue in cloud-init. Fixed in [1]. This failure can safely be ignored.

Required Further Test Validation:
=================================
bionic-lxd-vm - ALL
focal-lxd-vm - ALL

focal-ec2 - tests/integration_tests/modules/test_ssh_keysfile.py::test_nested_keys

focal-lxd-container - FAILED tests/integration_tests/cmd/test_status.py::test_wait_when_no_datasource

jammy-lxd-vm - tests/integration_tests/test_upgrade.py::test_clean_boot_of_upgraded_package

[1] https://github.com/canonical/cloud-init/commit/52cf702c28289b33d49642f8ee289f8dfc42332d

Hello James, or anyone else affected,

Accepted cloud-init into jammy-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/cloud-init/22.3.3-0ubuntu1~22.04.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-jammy to verification-done-jammy. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-jammy. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

Hello James, or anyone else affected,

Accepted cloud-init into focal-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/cloud-init/22.3.3-0ubuntu1~20.04.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-focal to verification-done-focal. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-focal. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

Hello James, or anyone else affected,

Accepted cloud-init into bionic-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/cloud-init/22.3.3-0ubuntu1~18.04.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-bionic to verification-done-bionic. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-bionic. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

All Failures:
bionic-azure.log:[2022-09-26T18:25:53.614Z] FAILED tests/integration_tests/modules/test_combined.py::TestCombinedNoCI::test_ssh_import_id
bionic-ec2.log:[2022-09-26T18:28:24.667Z] FAILED tests/integration_tests/modules/test_combined.py::TestCombinedNoCI::test_ssh_import_id
bionic-gce.log:[2022-09-26T17:53:09.191Z] FAILED tests/integration_tests/modules/test_combined.py::TestCombinedNoCI::test_ssh_import_id
bionic-lxd_container.log:[2022-09-26T16:40:41.893Z] FAILED tests/integration_tests/datasources/test_lxd_discovery.py::test_lxd_datasource_discovery
bionic-lxd_container.log:[2022-09-26T16:40:41.893Z] FAILED tests/integration_tests/modules/test_combined.py::TestCombined::test_correct_datasource_detected
bionic-lxd_container.log:[2022-09-26T16:40:41.893Z] FAILED tests/integration_tests/modules/test_combined.py::TestCombined::test_instance_json_lxd
bionic-lxd_container.log:[2022-09-26T16:40:41.893Z] FAILED tests/integration_tests/modules/test_combined.py::TestCombinedNoCI::test_ssh_import_id
bionic-lxd_vm.log:[2022-09-26T18:53:09.287Z] FAILED tests/integration_tests/bugs/test_lp1912844.py::test_get_interfaces_by_mac_doesnt_traceback
bionic-lxd_vm.log:[2022-09-26T18:53:09.287Z] FAILED tests/integration_tests/datasources/test_lxd_discovery.py::test_lxd_datasource_discovery
bionic-lxd_vm.log:[2022-09-26T18:53:09.287Z] FAILED tests/integration_tests/modules/test_combined.py::TestCombinedNoCI::test_ssh_import_id
focal-ec2.log:[2022-09-23T17:48:23.596Z] FAILED tests/integration_tests/modules/test_combined.py::TestCombinedNoCI::test_ssh_import_id
focal-gce.log:[2022-09-23T17:43:59.305Z] FAILED tests/integration_tests/modules/test_combined.py::TestCombinedNoCI::test_ssh_import_id
focal-lxd_container.log:[2022-09-23T16:52:24.813Z] FAILED tests/integration_tests/datasources/test_lxd_discovery.py::test_lxd_datasource_discovery
focal-lxd_container.log:[2022-09-23T16:52:24.813Z] FAILED tests/integration_tests/modules/test_combined.py::TestCombined::test_correct_datasource_detected
focal-lxd_container.log:[2022-09-23T16:52:24.813Z] FAILED tests/integration_tests/modules/test_combined.py::TestCombined::test_instance_json_lxd
focal-lxd_container.log:[2022-09-23T16:52:24.813Z] FAILED tests/integration_tests/modules/test_combined.py::TestCombinedNoCI::test_ssh_import_id
jammy-azure.log:[2022-09-23T19:15:17.043Z] FAILED tests/integration_tests/modules/test_ansible.py::TestAnsiblePullPip::test_ansible_pull_pip
jammy-azure.log:[2022-09-23T19:15:17.043Z] FAILED tests/integration_tests/modules/test_combined.py::TestCombinedNoCI::test_ssh_import_id
jammy-ec2.log:[2022-09-23T17:47:23.681Z] FAILED tests/integration_tests/modules/test_combined.py::TestCombinedNoCI::test_ssh_import_id
jammy-gce.log:[2022-09-23T17:33:56.230Z] FAILED tests/integration_tests/modules/test_combined.py::TestCombinedNoCI::test_ssh_import_id
jammy-lxd_container.log:[2022-09-23T16:59:59.688Z] FAILED tests/integration_tests/modules/test_combined.py::TestCombinedNoCI::test_ssh_import_id
jammy-lxd_vm.log:[2022-09-23T17:48:54.541Z] FAILED tests/integration_tests/modules/test_combined.py::TestCombinedNoCI::test_ssh_import_id
notes.txt:bionic-lxd_container.log:[2022-09-26T16:40:41.893Z] F...

Rerun content:

reruns/bionic-azure-wireguard.log
reruns/bionic-azure-write-files.log
reruns/bionic-ec2-ansible.log
reruns/bionic-ec2-set-password.log
reruns/jammy-azure-ansible.log

Hello James, or anyone else affected,

Accepted cloud-init into bionic-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/cloud-init/22.3.4-0ubuntu1~18.04.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-bionic to verification-done-bionic. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-bionic. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

Hello James, or anyone else affected,

Accepted cloud-init into focal-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/cloud-init/22.3.4-0ubuntu1~20.04.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-focal to verification-done-focal. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-focal. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

Hello James, or anyone else affected,

Accepted cloud-init into jammy-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/cloud-init/22.3.4-0ubuntu1~22.04.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-jammy to verification-done-jammy. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-jammy. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

SQA is happy to give a +1 for this version of cloud-init, tested on Bionic, Focal, and Jammy

Logs are internal to Canonical but can be found at
https://solutions.qa.canonical.com/testplans/testplaninstance/5f297fff-5b12-4cb9-b1de-9e947b21a1a1

Per Chris Patterson (cjp256) of Azure has given a +1 to the 22.3.3 release.

[1] https://irclogs.ubuntu.com/2022/09/27/%23cloud-init.txt

A user reported a bug during verification that prompted 22.3.3 and 22.3.4 releases. This bug has been confirmed fixed by the reporting user[1].

[1] https://bugs.launchpad.net/ubuntu/+source/cloud-init/+bug/1989686/comments/21

for context, the 22.3.4 code change found during SRU validation was related to specific non-standard Oracle deploy cases where images were cloned from buckets and didn't require additional full SRU verification as it can only affect a manual deploy path in Oracle and none of our automated integration tests are exposed to that path. As Brett mentioned, we performed manual SRU verification of LP: 198686 for that Oracle bug-fix.

This bug was fixed in the package cloud-init - 22.3.4-0ubuntu1~22.04.1

---------------
cloud-init (22.3.4-0ubuntu1~22.04.1) jammy; urgency=medium

* New upstream bugfix release. (LP: #1987318)
+ Release 22.3.4 (LP: #1986703)
+ Fix Oracle DS primary interface when using IMDS (#1757)
(LP: #1989686)

cloud-init (22.3.3-0ubuntu1~22.04.1) jammy; urgency=medium

* New upstream bugfix release. (LP: #1987318)
+ Release 22.3.3
+ Fix Oracle DS not setting subnet when using IMDS (#1735)
+ azure: define new attribute for pre-22.3 pickles (#1725)
+ sources/azure: ensure instance id is always correct (#1727)
[Chris Patterson]

cloud-init (22.3-13-g70ce6442-0ubuntu1~22.04.1) jammy; urgency=medium

* d/control: add python3-debconf to Depends and Build-Depends
* d/cloud-init.lintian-overrides: lintian fixes:
+ Fix systemd-service-file-refers-to-unusual-wantedby-target format.
* d/cloud-init.postinst
+ Lintian: Fix command-with-path-in-maintainer-script for grub-install.
* d/source/lintian-overrides: lintian fixes:
+ silence binary-nmu-debian-revision-in-source bug:
https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1014584
* d/p/expire-on-hashed-users.patch:
Add patch to ensure password expire doesn't apply to hashed users
* drop the following cherry-picks now included:
+ cpick-a2e62738-Fix-cc_phone_home-requiring-tries-1500
* New upstream snapshot. (LP: #1987318)
+ Fix v2 interface matching when no MAC
+ test: reduce number of network dependencies in flaky test (#1702)
+ docs: publish cc_ubuntu_autoinstall docs to rtd (#1696)
+ net: Fix EphemeraIPNetwork (#1697)
+ test: make ansible test work across older versions (#1691)
+ Networkd multi-address support/fix (#1685) [Teodor Garzdin]
+ make: drop broken targets (#1688)
+ net: Passthough v2 netconfigs in netplan systems (#1650)
+ NM ipv6 connection does not work on Azure and Openstack (#1616)
[Emanuele Giuseppe Esposito]
+ Fix check_format_tip (#1679)
+ DataSourceVMware: fix var use before init (#1674) [Andrew Kutz]
+ rpm/copr: ensure RPM represents new clean.d dir artifacts (#1680)
+ test: avoid centos leaked check of /etc/yum.repos.d/epel-testing.repo
(#1676)
+ Release 22.3 (#1662)
+ sources: obj.pkl cache should be written anyime get_data is run
(#1669)
+ schema: drop release number from version file (#1664)
+ pycloudlib: bump to quiet azure HTTP info logs (#1668)
+ test: fix wireguard integration tests (#1666)
+ Github is deprecating the 18.04 runner starting 12.1 (#1665)
+ integration tests: Ensure one setup for all tests (#1661)
+ tests: ansible test fixes (#1660)
+ Prevent concurrency issue in test_webhook_hander.py (#1658)
+ Workaround net_setup_link race with udev (#1655)
+ test: drop erroneous lxd assertion, verify command succeeded (#1657)
+ Fix Chrony usage on Centos Stream (#1648) [Sven Haardiek]
+ sources/azure: handle network unreachable errors for saveable PPS
(#1642) [Chris Patterson]
+ Return cc_set_hostname to PER_INSTANCE frequency (#1651)
+ test: Collect integration test time b...

The verification of the Stable Release Update for cloud-init has completed successfully and the package is now being released to -updates. Subsequently, the Ubuntu Stable Release Updates Team is being unsubscribed and will not receive messages about this bug report. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regressions.

This bug was fixed in the package cloud-init - 22.3.4-0ubuntu1~20.04.1

---------------
cloud-init (22.3.4-0ubuntu1~20.04.1) focal; urgency=medium

* New upstream bugfix release. (LP: #1987318)
+ Release 22.3.4 (LP: #1986703)
+ Fix Oracle DS primary interface when using IMDS (#1757)
(LP: #1989686)

cloud-init (22.3.3-0ubuntu1~20.04.1) focal; urgency=medium

* New upstream bugfix release. (LP: #1987318)
+ Release 22.3.3
+ Fix Oracle DS not setting subnet when using IMDS (#1735)
+ azure: define new attribute for pre-22.3 pickles (#1725)
+ sources/azure: ensure instance id is always correct (#1727)
[Chris Patterson]

cloud-init (22.3-13-g70ce6442-0ubuntu1~20.04.1) focal; urgency=medium

* d/control:
- add python3-debconf to Depends and Build-Depends
- Build-Depends: bump debhelper-compat to v10
* d/control: lintian fixes:
+ upgrade debhelper-compat to 10 and move it to d/control
+ d/compat: removed in favor of d/control
* d/cloud-init.postinst:
+ Lintian: Disable uses-dpkg-database-directly on legit use of it in
distros/debian.py
* d/cloud-init.postinst: lintian fixes:
+ Fix command-with-path-in-maintainer-script for grub-install
* d/p/expire-on-hashed-users.patch:
Add patch to ensure password expire doesn't apply to hashed users
* d/source/lintian-overrides: lintian fixes:
+ silence binary-nmu-debian-revision-in-source bug:
https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1014584
* drop the following cherry-picks now included:
+ cpick-a2e62738-Fix-cc_phone_home-requiring-tries-1500
* New upstream snapshot. (LP: #1987318)
+ Fix v2 interface matching when no MAC
+ test: reduce number of network dependencies in flaky test (#1702)
+ docs: publish cc_ubuntu_autoinstall docs to rtd (#1696)
+ net: Fix EphemeraIPNetwork (#1697)
+ test: make ansible test work across older versions (#1691)
+ Networkd multi-address support/fix (#1685) [Teodor Garzdin]
+ make: drop broken targets (#1688)
+ net: Passthough v2 netconfigs in netplan systems (#1650)
+ NM ipv6 connection does not work on Azure and Openstack (#1616)
[Emanuele Giuseppe Esposito]
+ Fix check_format_tip (#1679)
+ DataSourceVMware: fix var use before init (#1674) [Andrew Kutz]
+ rpm/copr: ensure RPM represents new clean.d dir artifacts (#1680)
+ test: avoid centos leaked check of /etc/yum.repos.d/epel-testing.repo
(#1676)
+ Release 22.3 (#1662)
+ sources: obj.pkl cache should be written anyime get_data is run
(#1669)
+ schema: drop release number from version file (#1664)
+ pycloudlib: bump to quiet azure HTTP info logs (#1668)
+ test: fix wireguard integration tests (#1666)
+ Github is deprecating the 18.04 runner starting 12.1 (#1665)
+ integration tests: Ensure one setup for all tests (#1661)
+ tests: ansible test fixes (#1660)
+ Prevent concurrency issue in test_webhook_hander.py (#1658)
+ Workaround net_setup_link race with udev (#1655)
+ test: drop erroneous lxd assertion, verify command succeeded (#1657)
+ Fix Chrony usage on Centos Stream (#1648)
[Sven Haardiek]
...

This bug was fixed in the package cloud-init - 22.3.4-0ubuntu1~18.04.1

---------------
cloud-init (22.3.4-0ubuntu1~18.04.1) bionic; urgency=medium

* New upstream bugfix release. (LP: #1987318)
+ Release 22.3.4 (LP: #1986703)
+ Fix Oracle DS primary interface when using IMDS (#1757)
(LP: #1989686)

cloud-init (22.3.3-0ubuntu1~18.04.1) bionic; urgency=medium

* New upstream bugfix release. (LP: #1987318)
+ Release 22.3.3
+ Fix Oracle DS not setting subnet when using IMDS (#1735)
+ azure: define new attribute for pre-22.3 pickles (#1725)
+ sources/azure: ensure instance id is always correct (#1727)
[Chris Patterson]

cloud-init (22.3-13-g70ce6442-0ubuntu1~18.04.1) bionic; urgency=medium

* d/control: add python3-debconf to Depends and Build-Depends
* d/cloud-init.postinst:
+ Lintian: Fix command-with-path-in-maintainer-script for grub-install
* d/p/renderer-do-not-prefer-netplan refresh to activators change
* d/p/expire-on-hashed-users.patch:
Add patch to ensure password expire doesn't apply to hashed users
* d/source/lintian-overrides: lintian fixes:
+ silence binary-nmu-debian-revision-in-source bug:
https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1014584
* refresh patches:
+ debian/patches/ec2-dont-apply-full-imds-network-config.patch
+ debian/patches/openstack-no-network-config.patch
+ debian/patches/renderer-do-not-prefer-netplan.patch
* drop the following cherry-picks now included:
+ cpick-a2e62738-Fix-cc_phone_home-requiring-tries-1500
* New upstream snapshot. (LP: #1987318)
+ Fix v2 interface matching when no MAC
+ test: reduce number of network dependencies in flaky test (#1702)
+ docs: publish cc_ubuntu_autoinstall docs to rtd (#1696)
+ net: Fix EphemeraIPNetwork (#1697)
+ test: make ansible test work across older versions (#1691)
+ Networkd multi-address support/fix (#1685) [Teodor Garzdin]
+ make: drop broken targets (#1688)
+ net: Passthough v2 netconfigs in netplan systems (#1650)
+ NM ipv6 connection does not work on Azure and Openstack (#1616)
[Emanuele Giuseppe Esposito]
+ Fix check_format_tip (#1679)
+ DataSourceVMware: fix var use before init (#1674) [Andrew Kutz]
+ rpm/copr: ensure RPM represents new clean.d dir artifacts (#1680)
+ test: avoid centos leaked check of /etc/yum.repos.d/epel-testing.repo
(#1676)
+ Release 22.3 (#1662)
+ sources: obj.pkl cache should be written anyime get_data is run
(#1669)
+ schema: drop release number from version file (#1664)
+ pycloudlib: bump to quiet azure HTTP info logs (#1668)
+ test: fix wireguard integration tests (#1666)
+ Github is deprecating the 18.04 runner starting 12.1 (#1665)
+ integration tests: Ensure one setup for all tests (#1661)
+ tests: ansible test fixes (#1660)
+ Prevent concurrency issue in test_webhook_hander.py (#1658)
+ Workaround net_setup_link race with udev (#1655)
+ test: drop erroneous lxd assertion, verify command succeeded (#1657)
+ Fix Chrony usage on Centos Stream (#1648)
[Sven Haardiek]
+ sources/azure: handle network unreachable errors f...

A regression in MAAS use case has been reported as:
https://bugs.launchpad.net/ubuntu/+source/cloud-init/+bug/1993836