openstack/puppet-openstack-integration - puppet-openstack-integration - OpenDev: Free Software Needs Free Tools

The inet6 prefix should NOT be added when the pymemcache backend is
used.
Change-Id: I6cf25aa19af9f35aadf72757c85e4efe0601b57f
(cherry picked from commit 8e42b85662)
(cherry picked from commit c40c78037d)

... and remove the unused compute_namespace parameter.
Depends-on: https://review.opendev.org/917938
Change-Id: I441ebec89adc7db836a28d23b883088bd6704fd0

... and also ensure that gnocchi publisher is completely disabled.
Change-Id: If4179972103b30b5e0aad195d4ed8497e15938bd

We already ensure that the redis is ready before starting services
which use redis as coordination backend, but we also have to make sure
that redis sentinel is up because we use sentinel now in a few
scenarios.
Change-Id: Icdfdfc8f5d501ed67094f5c6b77db81577cbaba5

oslo.cache 3.7.0 introduced new options to use redis or redis sentinel
as backend. To test the functionality to configure this backend, switch
the cache backend in scenario001(Redis) and scenario002(Sentinel).
The switch is made only in CentOS because Caracal (or master) packages
are not available for Ubuntu, but may be later made in Ubuntu as well
once UCA Caracal is released.
Change-Id: Ieb681f5bbbf28e1963ab346c17e07265769da4e6

... before starting the services requiring the backend. Some of these
services crash in case its coordination backend is not available.
Change-Id: Iaf7379bdd7d144d8a71e5f00358beb1dee442cba

The ceilometer-upgrade exec resource already subscribes the config end
anchor.
Change-Id: I2f45c8a1ad218c46a76c4a9b00afc4c9dbac1830

Since ceilometer-api was removed, ceilometer no longer provides any
API services, and do not use the SSL certificates generated.
Change-Id: I1f4e0ff19aa3b9ac70792a21c867f17b5cb0f009

amqp1 driver of the oslo.messaging library was deprecated and it is
no longer tested. This replaces usage of the driver by the RabbitMQ
driver.
Depends-on: https://review.opendev.org/861070
Change-Id: I17666d9507564acb05a69143879ca2ec4b0bdeb0

This adds a few more parameters so that we spawn less processes from
each service, to reduce resource footprint in our CI.
Change-Id: I30f32b6414960c341d64282d91b8f958c8996772

This enables usage of service user token for interaction with nova and
barbican to avoid failure caused by token expiration during operations.
This also enables service_token_roles_required option in authtoken
middleware to allow only users with the service role to use this
feature.
Change-Id: Id6b0aad7aa24af2b6d03d484ada23357828c4325

puppet-ceilometer now supports deploying separate polling agents for
individual namespaces, in addition to the single polling agent.
This enables that new deployment architecture in scenario002 so that we
test both architectures.
Depends-on: https://review.opendev.org/c/openstack/puppet-ceilometer/+/856850
Change-Id: Ifdd5adef1e7cbb37e8ab3e3c2b3a860128b46821

... because now cache parameters in the base ceilometer class are
deprecated.
Depends-on: https://review.opendev.org/826581
Change-Id: Ib34df6edf562b97c5754ed604a576e0751b3d7e1

The coordination backend is generally used by Ceilometer to support
agents running on multiple nodes. This change enables the coordination
backend to simulate that deployment architecture.
Change-Id: I067a52c1480f4040182d8fc3d4a46c4f74ea728d

by the new ceilometer::agent::service_credentials class[1].
[1] 9a5323ad18b9bc0e15b514ea98449a3ea5d58b68
Change-Id: Ia8940ef802160d07ca5a4483ae72ef43560a2ee9

The ceilometer::agent::notification::notification_workers parameter was
deprecated in favor of the new ``workers`` parameter[1].
[1] 15921006c595ff705be40c02d324a387c92a4339
Change-Id: Icf66763d7e0c1996426e48087e5848bbb0f1be8f

... because puppet-panko is being retired.
Depends-on: https://review.opendev.org/791916
Depends-on: https://review.opendev.org/794151
Change-Id: If9b13b63d009440e87a9f5ab671d8c1f9159ca6c

This change removes usage of the parameters related to ceilometer api,
because these parameters are already deprecated and have no effect[1].
[1] be7a359ad661aa5a3950974e25adf9aa343ee369
Change-Id: I9f2d86f8e1bc923cff5b7796e695ed7757bb90bf

Change-Id: Ie9efc39070db608185a358f817f1074fd4f5810f

Depends-on: https://review.opendev.org/#/c/724059/
Change-Id: If335f5b2af8f67de0073b8e82b96a4a200833221

In Puppet 3 there was a need to use absolute
names to prevent issues. Since Puppet 4 everything
is absolute by default which makes this not needed.
We need to change this everywhere so that we can
revert the pin in [1] that now prevents us from
using the latest version of the puppet-lint check
puppet-lint-absolute_classname_check that properly
checks that we dont use absolute names.
[1] https://review.opendev.org/#/c/697742/
Change-Id: I78b74fbeb08be7234189e4d266412fb7fb7a73c0

Moves all the <module>::debug parameters
to be set in <module>::logging::debug instead.
This is so that we can remove the deprecated
logging options in the init classes of all the
modules.
Change-Id: I107be315a6e1a0429c32d02b9a1df8a8957bb7ab

Fixes the use of deprecated parameters that
is now removed in [1]
[1] https://review.openstack.org/#/c/569608/
Change-Id: Ib1a1bbe735c3e810058303a52204497e13fe3903

Change-Id: If3a1c1299de725c23e2586453c9ab85e9db988b8

The --skip-metering-database argument for
the ceilometer-upgrade script has been removed
but are still used in the integration code and
was missed because Ubuntu was non-voting and
RHEL based packages seems to be an older version.
This patch depends on the change in puppetceilometer
that changes the default value for extra_params [1]
[1] https://review.openstack.org/#/c/548599/
Depends-On: I33c1667e19326ec67c5cf953daa1237175895c4f
Change-Id: I49f988afa96685b8d44f51525fa2d76731463bbf

The ceilometer api is no longer a thing and should not be installed
anymore. This change removes the legacy telemetry options and switchs
Ubuntu to use gnocchi/panko.
Change-Id: I065c3bc11d6cb5bab89c5face2d01b671a517210

In our beaker tests, we want to disable this as we do not have
any Nova dependencies.
Change-Id: I18b8e86217fb3bf9214946362e7910c30afa8196

This patch refactors all creation of RabbitMQ resources such
as users and ACLs to a define called openstack_integration::mq_user.
This will make sure RabbitMQ is automatically installed as well,
as there are times where dependencies to RabbitMQ are added to things
like Keystone which break Beaker tests in other repos (but we don't
know they're broken until the change merges).
In addition, instead of setting up dependencies on the tagged services,
we use the anchors provided which should hopefully test against them
as well.
Change-Id: Ib122ddd105529de5e12389cc9db2e4e09ec4ad54

Introduce configuration parameters to specify the oslo.messaging
rpc or notification backend as one of rabbit, amqp. The default
config is to use rabbit broker for both rpc and notification. Selection
of amqp for rpc will use brokerless qpid-dispatch router.
This patch:
* Adds notification_transport_url parameter across services where needed
* Adds rpc and notification parameters to config
* Adds qdr for rpc amqp1 configuration
* Modifies scenario001 for dual messaging backends
* supports ssl config
Depends-On: Id6ebc4ce8b0ffdb0be92a758dbf89c84c3274725
Change-Id: Ia2a79a2e1482f6f72426bc81c8e6d2a04cb211e3

Improving scenario001 use-case where we use Telemetry services for
Auto-Scaling. It's a end-to-end scenario, so it will really test all the
stack.
- It adds Heat to scenario001
- It runs TestAutoscalingGabbi test
- It increases token expiration to 2400
Change-Id: Ibaa44cf53b8c8fb59b765ce4f9b219dd65f38a42

Ubuntu and Redhat/Centos doesn't have all telemetry packages.
Instead of checking everywhere if we are on Ubuntu or Redhat/Centos,
this change uses a boolean 'enable_telemetry_legacy'.
If true, ::openstack_integration::ceilometer will configure ceilometer
with legacy services/configuration (without panko/gnocchi). If false,
Gnocchi and Panko backend is used.
scenario001 set it to true for Ubuntu and false for Redhat/Centos.
This centralize the kind of ceilometer deployement in one place.
This change also drops the now useless collector configuration and
configure the notification agent correctly instead.
Change-Id: If229829975d4f25ca0a2a3c6c93e674204d71dc2

The rabbit_host, rabbit_hosts, rabbit_userid, rabbit_password,
rabbit_port and rabbit_virtual_host parameters are being deprecated.
This change updates the p-o-i tests to use the default_transport_url for
the rabbit connection instead.
Change-Id: Icb15ad3b5d75a35afcb685f4ae03c5755031fc3d
Depends-On: I43ac3079da9e52179457ca1a34f4faee60d5617b
Depends-On: Ie63457370ae37ef5af5878b1a97b8bafa80a8189
Depends-On: Ia0c5b5072431bbc186c8b96b7f034e68e9248af3
Depends-On: I43500ac7be4296ea534266fa14ca37fc700b0092
Depends-On: If4dfe8b82518fc4e590731a805ee3115b11f4f47
Depends-On: I00d4782693c1f67b82673624d4d36822c9762303
Depends-On: If83c0f0e61a08061334536399a42767a305966b7

Change-Id: If16009125133ad16ebe79355cc15aedcb39c6e55

Configure Aodh, Ceilometer, Ironic and Nova authtoken sections with new
method.
Depends-On: I779cb0b76187f742555c5c77f3d6b97d35c6be28
Change-Id: I8f5b7f3d7392bfa4215fccd7defe953857cef3f6

Change-Id: Ia92ca1e56118e8fd625d20848c2554c446ad3dda
Closes-Bug: #1556164 

Stop using ceilometer legacy keystone loader
and switch to keystone auth plugin.
Change-Id: Ieea6d46cd86f3138295670935c7f4e09fcc12d17

1) Remove usage of verbose in Trove.
2) Rename Tempest parameter.
3) Rename Swift parameter.
4) Update parameters for Heat so we use 'password' auth_plugin.
5) Remove metering_secret, replaced by telemetry_secret.
Change-Id: Id770a7b03323b72ba37317e48085d9c15f106bc1

Change-Id: Ia4ba77e4ea6e2afe591772cb33cd4ca0080ef6a6

This matches the upstream parameter.
Depends-On: I8c01fac2c984f39e63b116c4a6433b2009a4943c
Change-Id: Idb72279d63fdaec08b5153cec460e82235b62d9c

This patch enables SSL by default on scenario001 for both Ubuntu &
CentOS7, like it's done for scenario002.
Change-Id: If7a6ae3825052420ac76b5c8899ce68f003cb903

Reducing workers will help us to consume less memory reduce the number
of timeouts we have in upstream CI.
* Neutron & Swift: reduce from 4 to 2 workers
* When possible, set workers to 2: aodh, ceilometer, gnocchi.
Change-Id: Ie064a9ad0389f112bbb69f4253f7f6dbc26deb0a

Update ceilometer.pp and neutron.pp so we don't have warnings in the
catalog.
They are related to some deprecations done some time ago.
Depends-On: I05a2714b8429d641387e2d9debf6b1c32e0d8e93
Change-Id: I28425d331961a6795827d10969094c95fc292bfd

PyMySQL is the new database driver when running MySQL.
This patch updates our manifests to run it, since our modules already
support it.
Change-Id: I758c5c3bc7295f57102098cbe0d2d0f3b0f2692e
Depends-On: I7604cca9e2d7bf0b93c820adec5f937f72b64fa8

Create manifests for each project and include them in the right
fixtures manifests, so we can reduce the code and avoid dupplicated
puppet manifests.
Change-Id: I66a98691b3014998f4c2529d2e3389ef1cbcc5f4