openstack/devstack-plugin-ceph - devstack-plugin-ceph - OpenDev: Free Software Needs Free Tools

CephFS drivers don't support cloning snapshots
into shares. Manila's tempest tests need to be
told this explicitly. So, update the gate hooks
that control tempest configuration.
This affects all legacy style CephFS jobs that
use devstack-gate. These jobs will go away soon,
and be replaced with Zuulv3 native style job
definitions and this patch is a stop-gap,
because devstack-plugin-ceph is a branchless
devstack plugin, and we need to support legacy
style jobs for a while.
Change-Id: I885ff78586540d01590f98cca2a00d55161dbe04
Signed-off-by: Goutham Pacha Ravi <gouthampravi@gmail.com>

Manila doesn't provide snapshots unless you
assert that you want them via share type
extra-specs. Tests that require "snapshot_support"
do this by creating a share type with that
extra-spec; so we don't need this config
option to be set.
It's actually detrimental when wanting to enable
snapshots on the Ceph driver [1]
[1] https://review.opendev.org/736827/
Change-Id: I41d6aa885e22d3f21150d49ae7e4a8f369cc96f5
Signed-off-by: Goutham Pacha Ravi <gouthampravi@gmail.com>

IPv6 export policy support was added to the Manila
CephFS-via-NFS driver in the Train release. This
devstack plugin is branchless, so we'll need to
check for the relevant branch to setup the ipv6
test harness.
The pre-test and post-test hooks will be deleted soon
when devstack-gate is dropped by manila test jobs
in the Victoria cycle. So this code is temporary
but required to make ceph-via-nfs tests pass
in stable/queens-stein branches.
Change-Id: I91a54a8f72d1d514afbfa769c7e8f2ac21d502dc
Signed-off-by: Goutham Pacha Ravi <gouthampravi@gmail.com>

In the master (Victoria cycle), manila's
devstack plugin will handle:
- enabling NFS ports for access from guest VMs
- setting up bgp speaker and peer for routing to
 ipv6 tenant networks
I'll clean this up up entirely when we backport
these changes to older branches of manila.
Depends-On: https://review.opendev.org/#/c/724202/
Depends-On: https://review.opendev.org/#/c/724204/
Change-Id: I1087c562ff753cb764a174130ce1fed21a9c7b12
Signed-off-by: Goutham Pacha Ravi <gouthampravi@gmail.com>

Depends-on: https://review.opendev.org/#/c/671134/
Depends-on: https://review.opendev.org/#/c/670510/
Change-Id: Ib812d2b960b1375129c7ff74c63c1acd2649102f

Allow running api and scenario tests
together in the manila test jobs.
Change-Id: Ifbf998d7c8a27ad22a39f46547d1548c052614d0

Add MANILA_TEMPEST_MIN_API_MICROVERSION and
MANILA_TEMPEST_MAX_API_MICROVERSION to the ci
post_test_hook. These options default to
the values specified in the api_version_request.py
file. On master branch don't set these as we
want to run with the latest.
Related-bug: #1781671
Change-Id: I085ed175dfbe132c80a6a86ab34a281b3c94f5f0

Use python3 compatible tempest test discovery and
install the relevant python3 libraries.
Change-Id: Iabd1952ddaba85316dec5cf60c89122dc3825912

Since manila-tempest-tests is now installed system-wide and not in a
virtual environment, use tempest installed system-wide to run them.
Depends-On: I0844cdb48b9d415bd341c4687620412178be871b
Change-Id: I8abe6ba29766ecaa7faade06a1b23520733139a2
Signed-off-by: Rishabh Dave <ridave@redhat.com>

TEMPEST_SERVICES global variable is not supported
by devstack since long back.
- I380dd20e5ed716a0bdf92aa02c3730359b8136e4
- I9c24705e494689f09a885eb0a640efd50db33fcf
Service availability of tempest known services will be
set by devstack with local check.
- I02be777bf93143d946ccbb8e9eff637bfd1928d4
This commit removes the unused TEMPEST_SERVICES setting
Related-Bug: #1743688
Change-Id: I4ad77632027438537a38d46145b389ef6de06c98

Fix in order for the tempest jobs run manila's
tempest plugin from the new plugin repository.
Change-Id: Id07f965e5b73d20ca99e75760d196d55c7b6fbc8

Zuul v2 uses 'jenkins' as user, but Zuul v3 uses 'zuul'.
Using $USER solves it for both cases.
Change-Id: I8cddbefaf006b6d54285fffe2a245a4a8ea8b251

Change [1] removed the tempest pin from the
pre test hook in manila proper.
Remove it here as well.
Closes-Bug: #1711815
[1] Ia402fb79e1de5c9925f575d635b9928475095f86
Change-Id: I2a6e1854718df272eb40d68cbe41d9ddfb962b71

for tempest configuration in manila post test hook to "nfs"
so that CIFS tempest tests will be skipped. Its
default value is ["nfs", "cifs"].
Change-Id: I96a5f6bfd5364740689538538bac8bb59187b9b6

... in the cephfs-nfs driver's Jenkins gate.
Change-Id: I8ba601835f8f1d989422c3e047dd84edd9441a3d

As per,
http://lists.openstack.org/pipermail/openstack-dev/2017-February/112872.html
a devstack plugin's pre_test_hook script can set options
in local.conf and not in localrc. Do so to unblock gate,
gate-manila-tempest-dsvm-cephfs-native
Closes-bug: #1668197
Change-Id: Ic426935f0c5c5aa66fddf496b6b97350ec56b5e5

The cephfs_native driver CI does not need the service image that is
being uploaded. Disable the upload until a need arises, for example,
when the CI does scenario testing.
Change-Id: I1ed0af5fd61829a075a41df2939f0377deb351b3

manila's cephfs-native CI tests cephfs driver, which does not support
glusterfs protocol. The glusterfs protocol is enabled by a manila's
tempest config option by default. Modify the config option to disable
glusterfs protocol.
Change-Id: Ia7a226d6a8b0ba5aeedcdf34e8a6f9a8dbbfda40
Closes-Bug: #1541377 

The manila API tempest tests for consistency groups (CGs) also test
the 'create_consistency_group_from_snapshot' API that is not
implemented by the cephfs native driver. So disable it by default in
the CI hook script.
Change-Id: Ibb6b15a98970262fab4bd98ad2bd4acd3990747f

Set option to enable tempests tests related to 'cephx' access type
for gate-manila-tempest-dsvm-cephfs-native CI job.
Change-Id: If162271d81cd0d2efafd2d33659946eda30134ba

Let the plugin setup and configure CephFS as the storage backend for
Manila. This is not done by default. Refer the README to do so.
Add 'pre_test_hook' and 'post_test_hook' scripts that would be needed
to configure Manila-Ceph CI jobs.
The following changes are also made:
* Install a development version of Ceph that is compatible with Manila's
 CephFSNative driver.
* The development version is a version greater than Infernalis. And
 from Infernalis onwards, the ceph daemons are run as user "ceph".
 So allow the daemons to run as user "ceph" for such versions.
* Enhance get_ceph_version to check Ceph version even when the
 ceph mon daemon is not up, by checking the CLI version.
Co-Authored-By: John Spray <john.spray@redhat.com>
Change-Id: I74314bfcc6b52d524bb84f2232a988f275b9afbf