openstack/puppet-openstack-integration - puppet-openstack-integration - OpenDev: Free Software Needs Free Tools

Change-Id: I88782bc32ecc6cdee47982a67dac8160112d0a3e
(cherry picked from commit a24472d3d8)
(cherry picked from commit e880c95ee0)

When tempest should be installed from source, we don't (shouldn't)
install tempest packages.
Depends-on: https://review.opendev.org/917083
Change-Id: Ic22610b897f6e3de8d9d0de11cc387314cdb0d7b
(cherry picked from commit 0ff08bc9aa)

The EC2-API project was marked inactive, because of lack of appropriate
maintenance effort[1] and the project was excluded from Caracal
deliverables. This removes testing with the puppet-ec2api module
because we are also retiring this module for the unmaintained project.
[1] https://review.opendev.org/c/openstack/governance/+/902625
Change-Id: Ic8c89e096e9b3acd5a71ec0be1bff20936977bcf

This enables the Tap-as-a-Service plugin in neutron to test the
deployment support we recently added to puppet-neutron.
Depends-on: https://review.opendev.org/906016
Change-Id: I1bed97477fa737733d5b59b7de085e61494c69f9

Telemetry integration test is explicitly enabled but it is later
disabled. We can just skip enabling it.
Change-Id: I48aedb22ac32d651db4029330d54ce25eb314764

In case an environment variable is set to a boolean value in ansible,
the actual value is capitalized(True or False). We have to ensure that
case is ignored when comparing such value with a reference.
Change-Id: Ic51e966acc7e6939dd17d60ab5e3971bd05e77d5

This reverts commit 9bdb8fc1f5.
Reason for revert:
This change switched package installation source to upstream source
in fact. Some of the plugin tests are still failing during the attempt
to re-swtich the installation source to distro packages so it's
better to keep using source installation for Ubuntu now.
Change-Id: Icffbf68ce37730ead26758f8c48b3d49b3011fb2

Ubuntu provides tempest plugin packages in universe. We can use these
instead of installing tempest from source.
This allows us to have better test coverage.
Depends-on: https://review.opendev.org/c/openstack/puppet-tempest/+/900696
Change-Id: Iccd10512b83635b25c60c899802d2ed7b97a48a6

We do not run mistral-tempest-plugin tests now, thus these test cases
are not run. These currently succeeds in CentOS and we have not clear
clue that these are broken in Ubuntu/Debian.
Change-Id: I594a63960a837c6469186495d7162ab247debe04

We don't require EPEL to install the tool packages.
In case it's needed to deploy services then it should be enabled in
the repo setup steps.
Change-Id: I7f499e16efd69b7822ed3a7db2c72a1d59e9bf3d

In integration tests we first run puppet to configure repositories and
then run puppet two times for testing. However we don't move the log
after the first repository configuration, and the file is overridden
by the first deployment run.
This ensures the file created during repository set up is being moved
so that we can review the full records.
Change-Id: Ia3f94d89423bc7c4b9a95f6b4ddb760fdcacfcee

This splits the existing function to repository set up and actual
package installation and adds an additional knob to skip setting up
puppetlabs repo (and install puppet from distributions).
Change-Id: I3568883537e8cc29f234754c78fc2425ad6a8f4b

The current version is quite old. Let's use the version currently used
in devstack jobs.
Change-Id: I2013bb2cba019574efc84045e60da6ce0feaedda

Ceph Reef has been released recently [1]. It has been requested by the
storage specialist to move openstack to it from Antelope on [2]. This
patch is moving p-o-i jobs to use Ceph Reef from CentOS Storage SIG
[1] https://docs.ceph.com/en/latest/releases/reef/
[2] https://review.rdoproject.org/r/c/rdo-infra/ansible-role-dlrn/+/49997
Depends-On: https://review.rdoproject.org/r/c/rdo-infra/ansible-role-dlrn/+/49997
Change-Id: I05f241235ef13b66ccd180bf21d1cfbd4f524de8

This enables manila with cephfs backend in scenario 004 test.
Depends-on: https://review.opendev.org/884461
Change-Id: I60d6ce301cf714cd918becaf493eb7396ec9631a

In Debian/Ubuntu we install tempest from source, thus all system
packages should be excluded to avoid conflicts between system packages
and packages installed by pip.
Change-Id: I2947d21ee75b53c3916b50151a401d26180590c9

Smoke tests of Mistral were re-enabled by [1] a while ago so we have
to remove this outdated comment.
[1] 388a029604
Change-Id: I69ffb860aef068dfd044f9262e61f78d1d0a3cfa

This enables the basic API test of Magnum so that we can ensure API and
the conductor services are running.
Also, recent magnum packages require python-werkzeug[1] and we don't
have to install the package additionally. This removes the outdated
(and unused) workaround.
[1] bafe87ce31
Change-Id: I5eb150def6744fb52043ef8413e72514d13f9c2e

Change-Id: I1fd10e3a25d26f69ffb386661446d5629af925f3

... to ensure basic heat functionality.
Depends-on: https://review.opendev.org/846018
Change-Id: I8294f1bdc21f82947c1d9533184de1a0be569fb4

These tests were disabled in the past but the problem no longer exists
in recent versions.
Change-Id: I8e304a13b0ebd20e7005e7369176208cca02e041

... because our modules no longer support CentOS 8. This also bumps
the default python version from 5 to 6 because master no longer
supports Puppet 5.
Change-Id: I941672eea72d9ee95ec571d0554cd86ded859d4f

Cinder V2 API tests were renamed long ago[1] and
the VolumesBackupsAdminV2Test no longer exists.
[1] e8afb8c2c5f948ee45e1c7edab4d82516920bd9a
Change-Id: I7ada16c0db4246facc3a1c4745cef4763479414b

... to validate basic functionality of Manila deployment in CI.
Depends-on: https://review.opendev.org/855195
Depends-on: https://review.opendev.org/855217
Depends-on: https://review.opendev.org/855719
Change-Id: Iabf85c7da0cdca1378ee52882fc6981a273441b9

... because the command is not available.
Change-Id: Icb5c507593cc609df08707394512268c84af39f0

Change-Id: I8d25953dc77f449a3b6cdf63be850b157014bec2

This enables cinder backend in Glance in scenario 005 job so that we
can test the deployment architecture as part of integration jobs.
Depends-on: https://review.opendev.org/844813
Change-Id: I22d48bc7616caf66157110d6f3f5d66d943aee43

Currently there is no test to check functionality of Horizon, and
because of this missing test coverage we didn't notice a syntax error.
This change attempts to re-enable the dashboard scenario test to ensure
horizon configurations can be loaded without error.
Related-Bug: #1965970
Change-Id: I30dd59631cc8a8ae5345c537058d8e08ed827ad3

This reverts commit 50c2dab063.
Reason for revert:
The issue was already resolved in the latest CentOS 8/9.
Change-Id: I9236986dcf5bc0e893ede89a2f8c67f4f2587ec8
Related-Bug: #1957913 

CnetOS 9 packages were already released in the puppetlabs repo.
This removes the workaround to use RDO packages, which was earlier
added to run integration jobs on CentOS Stream 9 before the packages
were released[1].
[1] f384effdb4
Change-Id: I0b9529b6a4f1c4beefa72b6e32b586b1ac9bea73

This change increases default swap size, installed by the run-test.sh
script, from 4GiB to 8GiB, because now we see frequent failures caused
by memory shortage.
This removes the separate ansible task to create an additional swap
space (added by f4429e07d8 ) because now
the enough amount is created by run-test.sh.
Change-Id: I24ebef234c79e636b24e47535732aea74e52a241

In integration job, there is a task to search selinux alerts but any
alerts don't effectively make the whole job fail, and we often observe
timeout caused slow sealert command with many denial records.
This change disables the task until we fix all of the current denials.
We capture audit.log in CI so we can review that raw file to find out
any denials.
Change-Id: Ic850acfb2b576224c194ceb361e690c5fbf89838

This change enables Octavia in scenario004 integration job so that we
can validate deployment of Octavia by puppet-octavia.
Because of limited resource in CI, noop driver is used and all of
backend operations like amphora instance management are disabled. This
is the same method as is used in a CI job in Octavia itself.
Depends-on: https://review.opendev.org/828063
Change-Id: I627872dd81d5ca576ea33ecf4755bf8de43df76a

Some options to include/exclude specific tests have been updated[1] in
Tempest and old options are deprecated now.
[1] dc84423b7294a19cbea4bf1e4b75a59625dec1e9
Change-Id: I6f766331e7e4f2f0b97ca4e9a3e655a480ecb28f

Recent iputils in CentOS 8 Stream removed capabilities on the ping
binary and requires the change in net.ipv4.ping_group_range to allow
unprivileged users to ping, however the change in systemd[1] is not
yet shipped.
This is a temporal workaround and sets the kernel parameter. This can
be removed once the fix is shipped as part of a new systemd package.
[1] https://github.com/redhat-plumbers/systemd-rhel8/pull/246
Closes-Bug: #1957913
Change-Id: I6fc0e7a62106c53d983818fc8c8b9d1e1cdebb31

CentOS has published the official mirror for CentOS Stream 9 [1]. In RDO,
we are working to get ready for it ASAP and we have the required repos
to run p-o-i on CS9 [2].
This patch is adding support to CS9 in p-o-i repo with the required
fixes. Also is adding integrations jobs for scenarios 0-4 and adding
them as non-voting. Note that we don't have promotion pipeline working
so i think it's better to not make it voting yet.
[1] http://mirror.stream.centos.org/9-stream/
[2] https://trunk.rdoproject.org/centos9-master/report.html
Change-Id: I9da46a6aaef3559b24d5a47fb0bde9ae1d09abdb

As discussed in [1] we'll go along with Pacific with Xena
on CS8.
[1] https://review.rdoproject.org/r/c/rdo-infra/ansible-role-weirdo-puppet-openstack/+/35706
Change-Id: Iafbcd03b03adfb8597f5a7025dd84574a08b952f