openstack/openstack-ansible-os_tempest - openstack-ansible-os_tempest - OpenDev: Free Software Needs Free Tools

This reverts commit 6c976e61a9.
Reason for revert:
Removal of setup.py caused problems with installation in tripleo-quickstart:
2022年03月31日 16:20:19.128604 | primary | ERROR: openstack-ansible-os_tempest from file:///home/zuul/src/opendev.org//openstack/openstack-ansible-os_tempest/#egg=openstack-ansible-os_tempest (from -r quickstart-extras-requirements.txt (line 5)) does not appear to be a Python project: neither 'setup.py' nor 'pyproject.toml' found.
Disable setuptools auto discovery
Jobs are broken due to a release of setuptools 61.0 introducing
non-backwards compatible breaking changes [1]
Setting py_modules to an empty string here will disable autodiscovery
and should permit jobs to run as before.
[1] https://github.com/pypa/setuptools/issues/3197
Signed-off-by: Neil Hanlon <neil@shrug.pw>
Change-Id: I8ee5fa36a6b0cbce2d1811d9f40202fd083e4767

Change-Id: I1a857edf7d84f02e440703d3fa5295519661efae

The patch bumps min version of tox to 3.18.0 in order to
replace tox's whitelist_externals by allowlist_externals option:
https://github.com/tox-dev/tox/blob/master/docs/changelog.rst#v3180-2020年07月23日
Change-Id: I4b6a73eb0cacadc291fa272f6e088d6d59914ce9

Change-Id: Ia77ee72f8205b65714f14cf5e0408226a85cdd09

This repo is now testing only with Python 3, so let's make
a few cleanups:
- Remove python 2.7 stanza from setup.py
- Remove obsolete sections from setup.cfg
- Cleanup doc/source/conf.py to remove now obsolete content.
Change-Id: Id681a9e25b677c687998698c33b4fb0a30d7d202

This sets the molecule framework files and job, so later we can write
tests for the role using it.
Change-Id: I16a67ff8acbadc7dce3746ca2ffc67aed660ed65

OpenStack is dropping the py2.7 support in ussuri cycle.
Only update required is in tox to define common baspython as py3 os that
all tox env including [testenv:functional] will use py3 instead of py2.
Complete discussion & schedule can be found in
- http://lists.openstack.org/pipermail/openstack-discuss/2019-October/010142.html
- https://etherpad.openstack.org/p/drop-python2-support
Ussuri Communtiy-wide goal:
https://governance.openstack.org/tc/goals/selected/ussuri/drop-py27.html
Change-Id: Ie6d4d5d86006dfa39645ff072b33a7471e10fc01

1. Sphinx 1.8 introduced [1] the '--keep-going' argument which, as its name
suggests, keeps the build running when it encounters non-fatal errors.
This is exceptionally useful in avoiding a continuous edit-build loop
when undertaking large doc reworks where multiple errors may be
introduced.
2. Remove the unnecessary blank line for tox.ini
[1] https://github.com/sphinx-doc/sphinx/commit/e3483e9b045
Depends-On: Ie837d376bb1a1d93367369d25140dd8a9d5ac14e
Change-Id: I19f60c960ad25e1d5df75e2bc024389e8d64abe9

This patch adds a `pdf-docs` tox target that will build
PDF versions of our docs. As per the Train community goal:
 https://governance.openstack.org/tc/goals/selected/train/pdf-doc-generation.html
Add sphinxcontrib-svg2pdfconverter to doc/requirements.txt
to convert our SVGs.
Change-Id: Ie3a57163d8c4fc00f3c677a8f6c198095de23756
Story: 2006105

It updates the url from git.openstack.org to opendev.org and
also remove cgit from opendev.org.
Keeping vagrantfile, run_tests.sh and bindep.txt as itis
as these are updated automatically by openstack-ansible-tests.
Change-Id: Ia449079776e0339515ae1a2bca7553b03d9cde1c
Signed-off-by: Chandan Kumar <chkumar@redhat.com>

Adapt the tempestconf job to use a variant of the integrated repo's
AIO test job.
Change-Id: Ib05c78339c25da8b3510f363e710992fd95bbeee

Since os_tempest already have support to python-tempestconf, adding a
job that test it on check and gate.
Change-Id: I2ae6057d197a7f7f40b2bb544dc2381ab8044aed

We want to default to running all tox environments under python 3, so
set the basepython value in each environment.
We do not want to specify a minor version number, because we do not
want to have to update the file every time we upgrade python.
We do not want to set the override once in testenv, because that
breaks the more specific versions used in default environments like
py35 and py36.
Change-Id: I8fc994880c7ccbe7356e4c6470d28bb925f8c880
Closes-Bug: #1801657 

In order to consume os_tempest role across different deployment
tools, following changes are introduced:
- tempest_install_method:distro|source through which user can install
 tempest from source as well as distro
- tempest_workspace directory is added as when tempest is installed
 from distro, we need a place where tempest can be executed. It
 generalised the use of tempest_workspace at each place.
- The default location of the default tempest configuration is now
 /etc/tempest/tempest.conf rather than the previous default of
 $HOME/.tempest/etc.
Change-Id: Ie280cfa6b93fa65c56ed98066deb4f9c82a1a8db

We want to default to running all tox environments under python 3, so
set the basepython value in each environment.
We do not want to specify a minor version number, because we do not
want to have to update the file every time we upgrade python.
We do not want to set the override once in testenv, because that
breaks the more specific versions used in default environments like
py35 and py36.
Change-Id: Ib892603c629c09ae9253a25350328d127acf5148
Signed-off-by: Doug Hellmann <doug@doughellmann.com>

The TESTING_BRANCH environment variable is provided by the
run_tests.sh script and is derived from the .gitreview file.
This ensures that once the master branch becomes a stable
branch, the constraints from the stable branch in the
integrated repository will automatically get used once the
.gitreview file is updated.
To ensure that the required environment variables are present
we export them appropriately in run_tests.sh and modify the
tox configuration to pass them into the tox test.
Change-Id: I19fc2e4ee2b16dd3c9343af9caf8ddd452f11125
Needed-By: https://review.openstack.org/579371 

We want to default to running all tox environments under python 3, so
set the basepython value in each environment.
We do not want to specify a minor version number, because we do not
want to have to update the file every time we upgrade python.
We do not want to set the override once in testenv, because that
breaks the more specific versions used in default environments like
py35 and py36.
Change-Id: Id03f88fbfa569bac36e61c457f3b8a17218f0519

Using tox for requirements management requires in-repo
requirements files for all our repositories. Rather than
do that, we make use of the tests repo to capture our
common requirements and use this to install them.
This reduces our review requirement rate and simplifies
maintenance for us for the tox config. It also makes it
usable with 'Depends-On', which is marvellous!
The tox requirements definitions for docs/releasenotes
builds are left in-place as those are standard entries
across the community. If that changes at some point, we
can re-assess those entries too.
Depends-On: https://review.openstack.org/579208
Change-Id: I479efa5547627f70bc41a30641c7e4afb4568fc1

Now that run_tests.sh handles the tests repo clone, we can
remove the use of the older tests-repo-clone.sh script.
Change-Id: Ibfb1b6266f8014a9ac40576f4182279a88791f46

In order to allow the use of the environment variable which informs
Ansible which user executed the playbook, we pass the USER env var
into the environment that tox builds.
Change-Id: I5e9642c77bdb046ea8ef5b7d4bd69d9fcdb7238d
Implements: blueprint python-build-install-simplification
Signed-off-by: Jesse Pretorius <jesse.pretorius@rackspace.co.uk>

For compliance with the Project Testing Interface as described in:
https://governance.openstack.org/tc/reference/project-testing-interface.html
For more detials information, please refer to:
http://lists.openstack.org/pipermail/openstack-dev/2017-December/125710.html
Change-Id: If9004d7215fde0a188f2a86fedfe3460ef748555

Currently the role tests use whatever versions of pip,
setuptools and wheel are already installed on the host.
When a version of these tools changes it often causes
problems for our testing.
This will ensure that we use a known good set of pins
which is maintained in the general SHA bumping process.
Change-Id: Idcd72a0204f8a008e25386e30f698195efa7eef8

When executing the tests repo clone in OpenStack-CI,
use zuul-cloner instead of git to enable cross-repo
testing. This ensures that if a dependent patch from
the tests repo is noted using 'Depends-On: <change-id>'
in the commit message, that patch will be included.
Change-Id: If75af45f9ebc17b85bbc8aec019714f4a3625753
Depends-On: Idce7abebf32f24c356a27e099fbca954d917402b

Trivialfix
Change-Id: Id966d1935b94b7f19bca4987093314e978e9daca

Some hacking have been removed,so we can delete them.
More details:
 https://github.com/openstack-dev/hacking/blob/master/setup.cfg
Change-Id: I52a2f13c2337ea8ab3b8e8f8c52a7ee1e9b58229

With the implementation of https://review.openstack.org/388087 all
tox targets may now use upper constraints.
Change-Id: Id7b1a20bf3a695fa5a2bcdbb02da5af436718590

This patch consumes the centralised Ansible test scripts
implemented in https://review.openstack.org/381853
Change-Id: Iea3a6f853b2347b1463644c89136a313711e7785

With https://review.openstack.org/381479 merged, setting this
variable in tox.ini via an extra var is unnecessary.
Change-Id: Ieae12c31ff712b6d4285a3389fe4fd7c2d32e511

Move tempest to use the central test repository as well as Ansible
2.1.1.
This mirrors the change made for the openstack-ansible-os_nova role,
whilst keeping tempest running on it's own container for testing
purposes.
Additionally this moves to use the testing scripts to simplify and make
the tox.ini file more uniform.
Co-Authored-By: Travis Truman <travis_truman@cable.comcast.com>
Change-Id: I06771dba022fa91bb0230a7c0ebe6d7872e80004

The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUFFERED is also set to ensure that the console log
from the CI jobs is recorded in the exact order of execution.
Change-Id: I815d71b01def2b327e1792cf98e2d336c09a5b2d
Related-Bug: #1620849 

This change enables log collection within the gate so that further analysis
on gate tasks can be performed post build. This is very useful when
debugging problems.
Change-Id: I376b5bf2d395314de5ed22489277eacd2fc32839
Signed-off-by: Kevin Carter <kevin.carter@rackspace.com>

As per [1] all linting tests can now use upper-constraints. This patch
removes all instances of the install_command override relating to lint
testing which were needed to negate the use of upper-constraints.
[1] http://lists.openstack.org/pipermail/openstack-dev/2016-August/101474.html
Change-Id: I29a852f67b1649e0cdca96231add1e69c8e5cb24

The plugin repo needs to be cloned for ansible-lint to
understand ansible plugins. The commands currently
reside in tox.ini under the ansible section and are not
currently included. This commit fixes that error.
Change-Id: I8bdc2891080630a4039f0abc310df378f0482a30

The 'docs' tox target executes the doc8 lint test which may result in
failures when testing documentation builds, but OpenStack-CI does not
execute that tox target.
In order to ensure that we catch all standard documentation syntax
errors and prevent them from merging, this patch includes the docs
target in the 'linters' chain of tests.
Fixes for any failures which result from executing this test are also
included in the patch.
Change-Id: I226bbaae1ea047bacbcd7579314bb1de11709ef3

With the implementation of https://review.openstack.org/321331 the
human_log callback plugin is now part of the plugins repo.
This patch removes the retrofitted version in tox in favor of using
the version from the plugins repo instead.
Change-Id: I57641f6829a573f7010e4e0054ecf8d79611a803

In order to prepare for the move of detailed configuration
content from the install guide to the roles, doc8 checks
are being implemented in the roles to ensure that any new
content submitted is properly checked.
Change-Id: I7a79e760fde2cca9295be1e6dea8575ec2f1fc85
Partially-Implements: blueprint osa-install-guide-overhaul

In order to prepare for implementing requirements management by the
OpenStack requirements management process, and to improve the
reliability and effectiveness of test execution, this patch implements
some changes to the tox configuration:
- The minimum tox version is increased in order to be able to use
 constraints for the python packages.
- The OpenStack upper-constraints are used when preparing the test
 venv for the linters checks.
- Any proxy environment variables set on the test host are passed
 into the venv to enable testing from behind a proxy.
- The environment variables used by Ansible tests are moved into
 a new venv called 'ansible' and this environment is inherited
 by all Ansible-related tests.
- The docs test will clean-up an existing build directory before
 executing the docs build.
- The releasenotes build cannot use upper-constraints at this point,
 so it doesn't.
- The Ansible role download will no longer ignore errors so that any
 problems discovered will result in a failed test.
- The human readable logging callback plugin is implemented for
 functional testing.
- The ansible test requirements are moved into tox.ini to ensure
 compliance for requirements.txt/test-requirements.txt for the
 global-requirements management contract.
- The ~/.ansible directory as a whole is not deleted. Instead only
 the plugins and roles folders are deleted to ensure that zuul's
 Ansible artifacts are left in-place.
- The ansible-lint version is updated to support execution against a
 folder, and the test now executes against the entire role to ensure
 that it captures all applicable files for lint testing.
This is a combined port of the following:
- https://review.openstack.org/323507
- https://review.openstack.org/338193
- https://review.openstack.org/332443
- https://review.openstack.org/338193
- https://review.openstack.org/339493
Change-Id: I0652e77ae0556be0499bc253504eee278870e0e3

Review [1] added a breaking typo to tasks/tempest_install.yml, which
we correct in this commit.
Additionally, this commit adds a functional test to os_tempest role
which deploys os_tempest itself and then runs some arbitrary keystone
tempest tests. Having this test in place will prevent basic issues
like the one introduced in [1] from being commited.
Note that we deploy galera into a container, however we can probably
skip that. Having it in a container gives us the ability to easily add
in more services if necessary. The installation of rabbitmq has been
excluded since that should not be necessary in the context of this
testing.
[1] https://review.openstack.org/#/c/309034/
Change-Id: I144118b5e70f558554107345088cb36693a85e25

Change-Id: Ic3b376bc4444ab896a56daab589dfb6f354d0b5c

Change-Id: I26cea8bede422a5e91ab3443a69fb77f1a7b0fde
Signed-off-by: Kevin Carter <kevin.carter@rackspace.com>