openstack/puppet-openstack-integration - puppet-openstack-integration - OpenDev: Free Software Needs Free Tools

Before create and add swap on system, check whether swapfile
is mounted. If so, try to swapoff the swapfile and remove it.
Change-Id: Ic3a9ffc34872a83a491412237369442f369c21d1

Currently, openstack-infra has create an proxy cache of
trunk.rdoproject.org. This is a short term solutions until we add RDO
to our AFS mirrors. Update repo.pp to start using it.
We also use the direct hash from delorean.repo, to avoid potential
issue where packages chages on remote node after we start downloading
things.
Change-Id: Id1819cf0dc49a89256a971ce9d8420622db901e8
Signed-off-by: Paul Belanger <pabelanger@redhat.com>

Until now, we were only supporting the Ceph mirrors for Ubuntu platform.
- Enforce http for OpenStack Infra AFS mirrors (https is not supported
 yet)
- Set CEPH_MIRROR_HOST to the right mirror depending of the platform
- Force https when possible
Change-Id: Ica91b23c0954ccee17ea13903048b6133758f9f3

choose a test without heat
checking a basic functionality of vitrage
sending an event to raise an alarm and see it in vitrage
Change-Id: I0bc2eb459e1ac4458833bac2d319a94b23b98b6a

We're now well past ocata-m3, so lets remove the exclusions we had for
issues with ocata ubuntu packages.
Change-Id: I7af84157a6c91c58981108747549c15ff8feb80a

We are hitting timeouts in IO bound processes as swift but we
don't have much information about what processes are causing
this IO peaks.
This patch adds iotop and iostat information to the logs in
addition to dstat output.
Change-Id: I4c50d4405a923eb2652fc39f6cea9889597ae44e

CI is currently flacky / broken.
1. ubuntu: exclude test_create_show_delete_firewall from tempest
f2088f3b7b
This patch broke us when running Tempest with Ubuntu Ocata.
 File "/usr/lib/python2.7/dist-packages/neutron_fwaas/tests/tempest_plugin/tests/api/test_fwaas_extensions.py", line 102, in _wait_until_ready
 if not test.call_until_true(_wait, CONF.network.build_timeout,
AttributeError: 'module' object has no attribute 'call_until_true'
2. Start Designate services after RabbitMQ resources are ready
This makes sure Designate services can start correctly at first Puppet
run and make second Puppet run idempotent.
3. Disable vitrage which is unstable now, until we figure out what's
wrong with configuration. It seems related to auth parameters.
Change-Id: I84921cbf4f4f838bff4f970113e709181801bed9

This reverts commit 9919ccfbb0.
Change-Id: Ieb444340b15b2d6866f82785d13c9143c7d050a6

ceilometer-api is being deprecated, so we want to stop running the tests
and move forward with Gnocchi tests, with auto-scaling (coming in future
patches).
Removing TelemetryNotificationAPITest that is not a valid use case
anymore when using Gnocchi.
Change-Id: I0e09dea793e86a6be40a2ccc4715a1dc9794713e

Tempest recently merged a change
I54a001cb562a8aac91537bf61e82a7e7d3498788 removing an option that
our designate packages still have. Lets pin until we promote.
Change-Id: Ifa1663f3b8f6cf51fb9911349885aa0ba6b9205a

Change-Id: Ibdb1e687ec348fa4147a9ca970b4f0f1c355ade9

Tempest-style tests have been migrated to tempest.lib, part of tempest.
Change-Id: I46e33abfaffd8d78240376b272a75f63f2c37e13

* TEMPEST_FROM_SOURCE is set to true to install tempest from source.
* Added capability to use tempest rpm
* change the cirros image directory to /tmp/openstack/image
 if the image gets firstly downloaded in tempest workspace,
 Tempest init will fail to create tempest workspace.
* Create image_dir if not exists.
Change-Id: I349783ace314a3575e93e6c853a7756f0f9b85ac

Since ocata-m2 has been published in proposed for UCA, let's see what
tests still fail.
Depends-On: I272c03f19d7182c4a731a1ef0fcbc2b9c6ca0b97
Change-Id: I4c8e102dea02e931abdc708f6ad2c508765a4c5b

When I run p-o-i on my laptop, logs go into / which is weird.
Default $WORKSPACE to /tmp, so when we run the scripts outside OpenStack
Infra environment, logs are visible in a safe place.
Change-Id: Ib8b0f9417098bcf703e31984804f2b72a8d93866

This reverts commit 4d6b918cef.
It activates Mistral testing again, module one test that fails all the
time:
https://bugs.launchpad.net/mistral/+bug/1654555
Change-Id: I763fd9b13ba94d1e76682a7a1c4264d7507c922c

Glance registry is not required for the v2 of the API and there are
plans to deprecate it in the glance community. Allow for it to be
disabled in tests.
Change-Id: I89f319f18f4cbda4244e96732a16df81a0f836b0

Tempest has been fixed upstream. We shouldn't have to pin it anymore.
Change-Id: I14ceda3ebad7797cbd278199ea3c3bc8151dbf66

We don't want to pin Tempest if we're running inside the Tempest gate.
This allows their patchsets to be properly tested inside the p-o-i jobs
that are running there.
If we're not running inside the Tempest gate, pin to whatever version
is in TEMPEST_VERSION.
Change-Id: If2221480fb13a69e64adc26fa6bc211bf563bfa8

Do not pin Tempest if the jobs are run in Tempest gate, so they can
actually see the errors we have without the pin.
Change-Id: I439dc6b8200a59f31c0227a124b4a2a6e8d443ba

openstack/tempest/master interface breaks Trove and more services.
There is an attempt to fix it here:
https://review.openstack.org/#/c/412511/
Let's pin Tempest until the fix works and is merged.
Change-Id: Iadf7c3164d2f16c5caa1b5d53089f35b22b7b289

This is a partial revert of the pin we implemented as part of
I2330faf700230fe40119169347ad72f8332d0821 to be able to promote the
RDO packages.
Change-Id: Id19998448591e9e3fb997602ec95a51cb2070889

On ubuntu these tests are flakey with ocata-m1. Let's disable them for
now.
Change-Id: Id0141edd8bf40449ef26b49ae94121f6779e0c3f

The launchpad bug was resolved+released
Change-Id: Ie20346dd6c4618866da47cded612319c03348fec

By including the whole application_catalog regex, we were trying to
run ~108 tempest tests on top of Murano.
Since Murano tempest tests already have the 'smoke' tag, let's just
rely on that to provide the testing that we need.
Murano still has 61 tests tagged as smoke but it's already a start and
we can lower that further by optimizing which tests are run directly
in the Murano tempest plugin afterwards.
Change-Id: I4d975b2c73e1f7fe8013d1ca7638a01b68a24971

The previous ec2api tempest regex was matching 161 tests so we were
trying to run all of that, greatly affecting testing duration.
We're lowering that to 14 which is much more reasonable.
Change-Id: Ib662094e588414bf7a87d2b9659d8e9ead0a0077

In specific cases, there may be conflicts between packages
provided by Centos and RDO repos. In that case RDO repos
should be used. To avoid any of these issues, this patch
updates packages right after enabling the repos.
Change-Id: Ide3265c5dc84971f19da2b5af049693cff5442b4

On fresh new ubuntu, modprobe command fails with error
complaining br_netfilter. After installing ebtables,
it got through it.
Change-Id: I53ae0d6e057b1845a53960bb4f7f96ebddab4336
Closes-Bug: #1644329 

This patch makes tempest version configurable so we can override
it in CI for DLRN promotion jobs for stable branches.
There have been some backwards incompatible changes in tempest
and ceilometer ( https://review.openstack.org/#/c/395506/ ) not
tagged yet in stable/newton. In order to get p-o-i pass with this
commits we need to use an updated version of tempest.
Change-Id: Ifb37a5a3a809c8a94d055d9cdc2b880e1ec9a115

To improve troubleshooting and readability, let's not have the puppet
logs print to the console. This change updates the puppet apply to
output the logs to puppet.log which will still be captured and provided
in the CI results. When the puppet apply fails, we will grep for
warnings and errors from the puppet log and only print those out which
should simplify troubleshooting failures.
Change-Id: I1084223f805f1960aebb9c5868fdef84ff3667e4

In Iedad1e0871388965acefb806369dc32b6c85cbd9 we merged the Murano
implementation but did not properly whitelist the application_catalog
regex for running tempest tests.
It doesn't look like the Murano plugin cares, though, since it ran
anyway but let's clean this up.
Change-Id: I4dd4abc7265ef295a8e6a2ae911dd5ec08006523

- install & configure Murano services
 - enable Murano tests in Tempest
Depends-On: Iae5e04fdd320dc16eb03974f3632f58d5389b565
Change-Id: Iedad1e0871388965acefb806369dc32b6c85cbd9

A fix was merged in Tempest so we need to update run_tests.sh to stop
pinning Tempest. Because of that we need to promote the repo otherwise
the downstream CI job will never update the packages.
After this patch got merged, we'll come back on the static URL.
- Unpin Tempest on CentOS
- Pin Tempest on Ubuntu (Ocata not packaged yet)
Change-Id: I2330faf700230fe40119169347ad72f8332d0821

Until https://review.openstack.org/#/c/389848/ is merged and promoted in
RDO, we need to pin Tempest.
Change-Id: Iaad03ec7d4263dca0a317031925df8e7ba4502b6

test_assign_unassign_private_addresses_by_addresses seems to be flaky
and is being disabled until the race condition has been identified
and fixed.
Change-Id: If4ffe5afec22619b2a33b63b1857b661d89dcc4b

Depends-On: I2a60bde92e8522362fefebc34c99cbb0346c6347
Change-Id: Ibebf638af2bf4daf867b7d06856bdf7758de54d3

Configure cinder backup to use swift and test
Change-Id: I9b645b2e7b76e97403b95459578979ec9f53c0b4
Depends-On: I588c9864cd20c75de7caecf733603a3587c34d12

https://review.openstack.org/#/c/363142/ was merged but it was basically
noop since the pattern to enable the test was wrong and reviewers missed
it.
This patch enables TestEncryptedCinderVolumes tests for real.
Change-Id: Iee97dfc3fc9b6a313f274dc1bee11ff8c1611782

Change-Id: I5566d1aea8a8393ffed0601b12986e2e4676ea59

In run_tests.sh we symlink a cached image to /tmp/openstack/tempest
or it is downloaded to that location using wget which is more reliable.
Let's use that instead.
Change-Id: I3777d9d035ceb31827b8df4264c2f7d213f50aea

This commit abandons the tox usage in run_tests.sh script. At this
point tox is only being used to create a venv and not run any tests.
The primary advantage tox gives you is maintaining separate test
environments by handling the venv management, job commands, etc. Since
we are only using it venvs, tox is a bit heavyweight when we can just
call virtualenv and pip directly. This just make it more explict so
people can see exactly what is happening when we run tempest. It also
continues the work to decouple running the tests in CI from the tempest
repo itself.
Change-Id: I57ded07a2fd2cde4d532f65e68bacbf62547cf1f

The tempest tox.ini is going to be changed to use the tempest run
runner, however the CLI is slightly different. To avoid being broken
by the change this commit switches to just using tox as a venv wrapper
and manually calling the test runner inside that venv. This should
isolate us from any changes in the tox.ini and also make how we
execute tests explicit.
Change-Id: I0529c2922242d8ed9c92ef718328e09f3ea9e05b

1) Add 2GB swap by default
Add some swap when running CI jobs, so we can reduce the number of
failures in CI related to missing memory.
By default 2GB, can be disabled or increased/decreased with parameters.
2) Promote RDO repository to have Oslo DB from master
python-oslo-db 4.13.x releases are known to break Gnocchi.
https://review.openstack.org/367221 will fix it, but it is not yet
in any release, so RDO unpinned oslo.db until that happens.
3) Disable Ironic testing on Ubuntu. Packages are broken in recent
 Newton upgrade. They are working on it.
4) Enable br_netfilter kernel module on Ubuntu.
See https://bugs.launchpad.net/cloud-archive/+bug/1621651
Even if it's not critical, it's a nice-to-have because it removed the
ERROR that we had in neutron logs. We'll see how the bug report evolve
and maybe remove this workaround.
5) Export lsmod in logs, easier for us to debug later.
6) Disable linuxbridge on scenario003 for Ubuntu
Also see https://bugs.launchpad.net/cloud-archive/+bug/1621651
7) Pin Puppetlabs release package.
Context: https://tickets.puppetlabs.com/browse/CPR-378
Change-Id: I732ef375a681f03af751ebb6ebd5b12df55a0ecc

1) Promote RDO to latest trunk
2) Configure puppet-keystone to manage credentials, as it's now required
 by keystone upstream.
3) Run Zaqar tests against API v2 (1.0 is deprecated and 1.1 will be
 deprecated soon).
Depends-On: I364f65c7009e400f2851e37999e1d8c0b6f5fd5a
Change-Id: I967038c872628a5a290e2890641c9c8dac45588d

This patch broke us:
993ba893ca
Until we fix it, let's disable the tests.
This reverts commit dfa7e56254.
Change-Id: I988dc7c742fe7669386aec8701ffce4d22f0bcd6

https://review.openstack.org/358670 has merged.
This reverts commit 0aba68d737.
Change-Id: I6fd651bc667bbb36e53e686a9c41ba5f18f0448d