openstack/puppet-openstack-integration - puppet-openstack-integration - OpenDev: Free Software Needs Free Tools

The ceph repository is also included by delorean-deps.repo .
The version in the file is better aligned with the OpenStack packages.
Change-Id: I48cc74a20d8210fe36437ecf022a7276634476fe
Signed-off-by: Takashi Kajinami <kajinamit@oss.nttdata.com>

RDO packages in puppet-passed-ci tag hasn't been updated for some time.
Use the current tag to test against more recent code.
Change-Id: Id7c6e0e5947d49d31331ad356fdcddc0fde2ec8e
Signed-off-by: Takashi Kajinami <kajinamit@oss.nttdata.com>

We removed these environments by the recent refactoring[1] but these
were actually needed to inject the required mirror facts.
This also fixes the handling of UCA mirror.
[1] 8f2bced9a0
Change-Id: Ib9ed229f9224498769aa47f997af60d48ae01943

This refactors the script based on the following points.
 - Remove unused environment
 - Select facts according to distribution
 - Create temporal .repo file only in CentOS
 - Create a centralized option to control OpenStack release
Change-Id: I34829b4d9737eda16e1c08863ce9ebb74f402b8d

Ceph Reef has been released recently [1]. It has been requested by the
storage specialist to move openstack to it from Antelope on [2]. This
patch is moving p-o-i jobs to use Ceph Reef from CentOS Storage SIG
[1] https://docs.ceph.com/en/latest/releases/reef/
[2] https://review.rdoproject.org/r/c/rdo-infra/ansible-role-dlrn/+/49997
Depends-On: https://review.rdoproject.org/r/c/rdo-infra/ansible-role-dlrn/+/49997
Change-Id: I05f241235ef13b66ccd180bf21d1cfbd4f524de8

This is follow-up of I5549e5edea33e720a7d5cf67c3056036daca52fc and
always disables ceph repository in Ubuntu Jammy. This is required to
disable the repository in litmus jobs.
Depends-on: https://review.opendev.org/871542
Change-Id: I79aefa3e9d19c34fa6f13c861008cce3f6cb97ef

... because the Zed release is available for only 22.04.
Because Ruby 2 is no longer available in Ubuntu 22.04, this drops all
tests with Puppet 6, which supports only Ruby 2. (Ruby 3 is supported
since Puppet 7.8.0)
Also, this disables the separate ceph repository because the upstream
repository does not yet contain packages for Ubuntu Jammy. We install
ceph packages from UCA for the time being but would revisit this later.
Depends-on: https://review.opendev.org/c/openstack/puppet-nova/+/865105
Change-Id: Icbfe677dadb3dab96ea06afe650c524b4abbb753

... instead of using the upstream repository.
Change-Id: Ic3cc04347f0ff683260772acbffd50ba0d87c582

Change-Id: I1fd10e3a25d26f69ffb386661446d5629af925f3

... because our modules no longer support CentOS 8. This also bumps
the default python version from 5 to 6 because master no longer
supports Puppet 5.
Change-Id: I941672eea72d9ee95ec571d0554cd86ded859d4f

Ceph packages for CentOS 9 are already available in mirror but these
are placed in a slightly different url.
This change updates the repository url used in integration jobs and
litmus jobs.
Change-Id: I7a1ab46523698e97d3329998de66729f113f166d

Change-Id: Ic5c3630c2e5fa7d3ec347b928a9b0b5f3093e28d

Change-Id: I97995b6821a24b64edbc5b1e874ba67a0418f96a

CentOS has published the official mirror for CentOS Stream 9 [1]. In RDO,
we are working to get ready for it ASAP and we have the required repos
to run p-o-i on CS9 [2].
This patch is adding support to CS9 in p-o-i repo with the required
fixes. Also is adding integrations jobs for scenarios 0-4 and adding
them as non-voting. Note that we don't have promotion pipeline working
so i think it's better to not make it voting yet.
[1] http://mirror.stream.centos.org/9-stream/
[2] https://trunk.rdoproject.org/centos9-master/report.html
Change-Id: I9da46a6aaef3559b24d5a47fb0bde9ae1d09abdb

According to the Ceph documentation[1] we should use the debian-* repo
for ubuntu and the ceph-deb-* repo no longer exists.
[1] https://docs.ceph.com/en/latest/install/get-packages/#ceph-release-packages
Change-Id: I7de0394eec856fc6d242f7b4872694324fdd12b7

As discussed in [1] we'll go along with Pacific with Xena
on CS8.
[1] https://review.rdoproject.org/r/c/rdo-infra/ansible-role-weirdo-puppet-openstack/+/35706
Change-Id: Iafbcd03b03adfb8597f5a7025dd84574a08b952f

The delorean-deps.repo file includes repositories hosted by CentOS
mirror. We should replace repository url to use local mirror instead
of external one in CI.
Change-Id: I940e48f6037e5bf3147f7f8e2fc9663947ce0de2

This reverts commit 993a26d0a6.
Reason for revert: The commit was made in a wrong branch.
Change-Id: Ie792ed08e9119943e64cca072a03473d69f50200

Change-Id: Ia19de894492e1904957edff48de2fe3d0b5c50ec

EOL of Nautilus is coming soon (2021年06月01日) so let's switch to newer
version now.
Change-Id: Idd9e509e49827ce490819df762108afd50585153

REDHAT_SUPPORT_PRODUCT* are removed from recent
CentOS8.3 release[1], Let's use ID/VERSION_ID instead
which are available[2] and would serve our purpose.
[1] https://git.centos.org/rpms/centos-linux-release/c/2e3df0
[2] https://www.freedesktop.org/software/systemd/man/os-release.html
Change-Id: If14f4edad391fd9ee61851859ecdd3a51b97a215

Luminous is still used for Debian jobs, but mirror host doesn't provide
the required contents.
Change-Id: I1120e881b0e7844978024ccab03b1f2eab97b098

... because mimic is no longer hosted in the mirror repository[1].
[1] http://mirror.iad.rax.opendev.org/
Closes-Bug: #1902670
Change-Id: If7653b7991387116ff8a9a3ea3f038ec01a27985

... because we now use nautilus in our CI.
Change-Id: I4d253c4880b263c1b138dd817eec105d5445ce49

Change-Id: I6b3c9fd006d9dad71ceb2ea6c84596369afe9c0a

... so that we can set up RDO CentOS8 repositories correctly by puppet.
Depends-on: https://review.opendev.org/#/c/741867/
Change-Id: I93e4f9916d3f444379bd9a901448d852bc702a04

Change-Id: Iafd57e7a27ed41a445f48d9e07086d0c153d6758

CBS mash repositories are being removed by CentOS team [1]. Actually it
was never a good practice to consume them directly although in some
cases was needed because of issus publishing packages.
[1] https://lists.centos.org/pipermail/centos-devel/2020-March/036679.html
Change-Id: I42fde8356757f0a100a549072834bc97dd0768bf
(cherry picked from commit 6da1dd3f17)

Promotion pipeline for RDO CentOS8 is setup and
running[1], on success puppet-passed-ci repo get's created,
let's use it instead of consistent which is not tested with
puppet-openstack-integration jobs.
[1] https://ci.centos.org/view/rdo/view/weirdo-pipelines/view/weirdo-promote-test-puppet-centos8/
Change-Id: Ib11d3dd95bb0d04176f8e06b247c7f0b81b77314

Initially these jobs will be running as non-voting,
once stabilized will be moved to voting.
RDO with CentOS8 has moved to component based repos[1],
where for each component have it's own repo, the list
of component can grow/shrink with time so instead of
using base path to configure repo, pull repo files
directly and adjust proxy.
[1] https://review.rdoproject.org/r/#/c/22394/
Change-Id: I1de859f29c933d895fb5cd2b7f1897517e11385c

- scenario001 and 004 will be running without ceph
 until ceph repos get available for CentOS8
- scenario003 will run not run with linuxbridge until next CentOS
 minor version as it has issues:-
 - https://bugzilla.redhat.com/show_bug.cgi?id=1720637
- Add Puppetfile_centos7 to have different puppet modules
 as compared to other distros. Currently only puppet-mysql
 needs to be kept pinned for centos7 as newere mariadb version
 is required to remove the pin, CentOS8 and ubuntu have required
 mariadb version so pin is removed. So automatic updates of puppet
 modules will not be applied for CentOS7 as those jobs are going to
 be removed in coming months.
- check for rdo_dlrn url existence only for RedHat distros.
Change-Id: I98fc088cd87c1412544f9590ce7a925b413297e2

Change-Id: I7a133a2aee0df752763c9e06909cedf4a2d5e37c

Ceph Nautilus has now a stable release 14.2.0 and it's being packaged
in CentOS Storage SIG. Mimic release was not LTS so let's replace it
by Nautilus where possible.
Since nautilus, the supported store backend is LVM which can use a block
device directly (not loopback) or a LVM logical volume for OSDs.
This patch is creating a LVM structure to create the OSD used to
validate Ceph and switching scenario004 to use nautilus instead of
mimic, so we will keep testing both Luminous and Nautilus, LTS releases.
Depends-On: https://review.opendev.org/#/c/650263/
Change-Id: I81441237a8b7cf651fa6926b2eb3c4ed0d42bb58

Adds support to set the jobs to use Ceph
Nautilus when testing.
Change-Id: Ibf2b82435a0f9c29d363c67a973399228bfb90a3

[1] Created promotion jobs which promotes
fedora/current repo to fedora/puppet-passed-ci,
let's consume the tested repo[2].
[1] https://review.rdoproject.org/r/#/c/16899/
[2] https://trunk.rdoproject.org/fedora/puppet-passed-ci/
Change-Id: Ie5a2cbf5a4a1083736b86b943dbf7c330530871b

When running in CI the ceph packages are mirrored
and the official download.ceph.com is not used.
This changes so we apt::pin the proper mirror that
the ceph packages come from, otherwise the ubuntu
cloud-archive ceph packages will be installed instead
of the official ceph ones.
Change-Id: Ica5e74bc67663541f8564a8920db5567f6c85197

The $DLRN_DEPS_BASE was not properly being evaluated because the string
was in single quotes. This would to a failure if you manually ran the
acceptance tests on a centos7 vm.
Change-Id: I158346b3d6685b6dd88662026c0f04a99a085021

Change-Id: I7dc23d2a5c22c269929f82ac5579d913d4827c45

Change-Id: Ie4bd3c46882a1cd4ec2be8c6bb4850e17fe79905

We are closing in on adding Ceph Mimic support and
want to ensure we can select either Luminous or Mimic
for running our tests.
For example Ubuntu 18.04 must run Ceph Mimic because
Luminous is not available (yet), Debian doesn't have
Ceph Mimic packages so we must run Luminous there.
Depends-On: https://review.openstack.org/#/c/576247/
Change-Id: If84ecbf86f3ebde8e69a1a26759ad967d061725a

For CentOS it's same as now, for fedora:-
delorean trunk:- trunk.rdoproject.org/fedora/current
delorean deps:- trunk.rdoproject.org/fedora/stable-base/latest
Change-Id: I5d681aa56868aa977c1c3dad2cc50336a1ce91bb

Currently, variable NODEPOOL_PUPPETLABS_MIRROR for centos has an
extra slash character at the end. It seems this is not a problem when
using a mirror, but it fails when using puppetlabs yum repo as the
url [1] gives an 404 error, while [2] works fine.
[1] https://yum.puppetlabs.com//el/7/PC1/x86_64/repodata/repomd.xml
[1] https://yum.puppetlabs.com/el/7/PC1/x86_64/repodata/repomd.xml
Change-Id: Idf3a080322f117e62dec291f3047e9b5408813b9

Change-Id: Ia832c1f8dd27bd1ec919f9156df38a67b4d51cc1

Since we're in queens and UCA now has a queens repo, let's switch to it.
Additionally renaming the RDO repo name to master to reflect that we're
actually testing master at the moment and switching dependencies repo to
master in RDO too.
Change-Id: Ic515c0ddd0f8809513a99c9ad70de5d10e35e378

Change-Id: I9a576bcb112d2a604717aa7ec6c1cbdcc82a5d79

Change-Id: Idf3287b13d8a1508ad1dc3fad498a8eb0259ebf4
Depends-On: Ia5db0bcc884d47c918c7da6657aa5b9bfdcdce44

This change splits out the facts from the run_tests.sh so it can be
leveraged elsewhere (like beaker) to write out the mirror information to
as static facter facts.
Refactor to fix hitting rdpoproject.org directly.
Added missing UCA nodepool variable.
Change-Id: Iae985e8b976850d8386390cfbadb75e434463479
Signed-off-by: Paul Belanger <pabelanger@redhat.com>