openstack/openstack-ansible-rabbitmq_server - openstack-ansible-rabbitmq_server - OpenDev: Free Software Needs Free Tools

Add file to the reno documentation build to show release notes for
stable/stein.
Use pbr instruction to increment the minor version number
automatically so that master versions are higher than the versions on
stable/stein.
Change-Id: I2962c47e99404ed6ea0edea96744f6119c988a52
Sem-Ver: feature

This patch adds the Debian jobs for this role to make sure
it's always passing as well as updates the meta to reflect
it's support of Debian accordingly.
Depends-On: I135ea73604890eae5e9e2a7cdcab81b2b39ad426
Change-Id: Idd35e42c8b224d6c69acaa9361587bc25ba19b5d

This patch adds support for this role to be able to deploy on
Debian Stretch.
Change-Id: Ia34d43731d880af3b663e62323c14cf77098c984
Needed-By: I9a92b73c419a0dc1cca40dacfef75de61a61db94

sphinxmark is no longer compatible with the latest release of Sphinx
which is causing all of our documentation jobs to fail. This patch
removes it as our current usage of openstacktheme for documentation
already provides watermarks for current branch and notices for which
branch the documentation covers.
Change-Id: I8db91976d1077ef1cc52485179900a4271940bcf

With this configuration, the database Mnesia reduces the activity to the
disk. It is useful when a huge of queues/exchanges/bindings are created
and destroyed.
With the default value (100), RabbitMQ could log {Mnesia is overloaded}.
Moved to 300. The range should be between 100 and 1000.
Read [1] for more info.
[1] http://erlang.org/doc/man/mnesia.html#dump_log_write_threshold
Change-Id: I6dcfc9db02bcd8c8f0a1ebf58d9c3ceb84cae10a

Change-Id: Ie39e19af6606487b39d088e3f2a1bec5f8f161f6

The rabbitmq bind address can now be set using the
`rabbitmq_port_bindings` option which creates a hash of rabbitmq
connection options allowing multiple bind addresses and port
configurations to be present.
This change also organizes the config so that its now far more human
readable.
The option `rabbitmq_disable_non_tls_listeners` has been removed. This
was done because it is now irrelevant given its possible to set the
specific bind addresses and port configurations.
Change-Id: I103e406f5393a4ce3f7d6cd7f7e25e2058b0e796
Signed-off-by: Kevin Carter <kevin@cloudnull.com>

The override rabbitmq_memory_high_watermark can be used to
alter the overall memory consumption of rabbitMQ and more
importantly define when the garbage collection (gc) is happening.
The old default value of 0.4 can lead up to 80% memory usage
during gc which can lead to OOM scenarios.
The new default value is set to 0.2, lowering the maximum memory
usage to 40%
Change-Id: Iedbb459a5d17f16bbb204b0b8e989ae84c77f8a6

We have in the past provided "safe defaults" in the role, because
this role is focused on a rabbitmq server for openstack.
Nowadays, this role is used outside OpenStack-Ansible, and should be
made more independant of it.
Having default policies is a problem because it forces users to define
an empty policy as an override, or their own policy, overriding the existing
"safe default".
This provides a boolean, defaulting to false, to conditionally add the
openstack queues policies. If set to true, we'll apply the "previous behaviour"
to automatically deploy the "safe defaults", which is adding
`rabbitmq_openstack_policies` to the user defined ``rabbitmq_policies``.
Depends-On: https://review.openstack.org/640300
Change-Id: I0bf6e1829ade63052c0c7efe81afb0b765857687

Without this policy, the queues reply_*, *_fanout_* are mirrored, across
all the RabbitMQ nodes.
It is not necessary to mirror the queues above, because they are usually
bound to one specific consumer, so the mirroring is not essential.
The new policy reduces the number of mirror queues and increases, in
general, the performances because it reduces the number of copies across
the cluster.
More info about RabbitMQ HA [1]
[1]: https://www.rabbitmq.com/ha.html
ref:
http://eavesdrop.openstack.org/meetings/oslo/2019/oslo.2019年02月25日-15.22.txt
Change-Id: I783d314aaa68b09abb4fed90818165b9e61e9758

Change-Id: Ib99c6c864f0ceed1985f420773df57720ab63167

The private option on include role was never implemented and
will no longer be developed. This change removes the option
so ansible no longer raises a deprecation warning.
Change-Id: I707a4eef58dd14ef5bc0161af15e20bb0c4bf977
Signed-off-by: Kevin Carter <kevin.carter@rackspace.com>

Depends-On: https://review.openstack.org/633272
Change-Id: If5e248566911f7545d6f230fb67d98af08e336f8

'Apply rabbitmq policies' requires rabbit to be started
"stderr": "Error: this command requires the 'rabbit' app to be running on
the target node. Start it with 'rabbitmqctl start_app'.\nArguments
given:\n\t-q -n rabbit@infra1 list_policies -p /
Change-Id: I585bca0b2a8f7061c1ab9adb417d0aa1f396ea88

Change-Id: I8e40c7a749817f11d1773d3f6ab2c34adf049104

We want to default to running all tox environments under python 3, so
set the basepython value in each environment.
We do not want to specify a minor version number, because we do not
want to have to update the file every time we upgrade python.
We do not want to set the override once in testenv, because that
breaks the more specific versions used in default environments like
py35 and py36.
Change-Id: I7704b6d9620eb3bd4c98a57f82268422fcb1852a
Closes-Bug: #1801657 

We make remote network hits to get the GPG keys which are quite
unreliable, and apt_key does not support using a proxy properly [1]
so let's store them inside the role and use them.
The implementation here matches that which was done in the
galera_client role in I520ccbadf3320b0d07fc83e3dbec9ea2bd16ec83
[1] https://github.com/ansible/ansible/issues/31691
Change-Id: I2715c904975b7940af72bd422904e748d3bae953

We shut down all of our RabbitMQ instances during an upgrade which
means that when it tries to apply the policies, everything is still
shutdown.
Change-Id: I3e0f976481819548f18b8d1ce90da89cda88053c

openstack-dev was decomissioned this night in https://review.openstack.org/621258
Update openstack-dev to openstack-discuss
Change-Id: Ic3212334695a929046abbed38f2e86672665d7d3

Fall back to the erlang-base package on arm64 architecture as
the erlang-base-hipe package is not available.
Change-Id: Ic8aeec9cab6aacb5c48755ea7ddd8a3768b5c343

'rabbitmq_apt_packages' has been deprecated since Newton and can be
removed.
Change-Id: I20cfae2dfe2aa3c63fd9e10ccbc217b68b31fcbe

The rabbitmq package installed on both xenial and bionic is actually
the same, allowing the vars files to be consolidated. The package has
also been updated to the latest stable release, 3.7.8.
The repo used for distro based installs has also been changed to
packagecloud.io. New packages have not been published to rabbitmq.com
for a while, the latest release there was 3.6.15.
Change-Id: Id49a8788593c5d64fc9c149c8912565bc3b05a3f

The yaml should start with "---"
Change-Id: I2b60f713ef94af587fee4c32a1e45e016a1209f5

Previously the 'distro' install method was implemented as the
default for CentOS and SUSE, however, some remnants were left
behind, making the configuration confusing and causing some
issues due to the gpg verification on RedHat trying to use the
RabbitMQ gpg check.
Rather than try and keep the many confusing installation methods
for these distributions, we simply remove the other options and
all the config entries related to it.
As part of this, we need to clean up the functional tests which
previously implemented checks based on the 'file' install type
which is no longer used by any distribution.
Change-Id: I28199ce149f6893d688d11177ec950b17dbf0886

Change-Id: I8d02208e3be80c50a24313f2939df671fa22036d

In I473b4162e141e05692e89f0420ea74c745dfc9e5 we forgot
to remove the ansible-role-requirements.yml entry for
previous_rabbitmq_server, so we do it here.
Change-Id: I1e844b0bfa41296075221992472d9369242e22ee

rabbitmq is started three times:
1st time in rabbitmq_install with default config
2nd time in rabbitmq_set_cookie with default config
3rd time in rabbitmq_post_install with OSA config
however, there is no need for that and we can remove the 1st one and
the 2nd as it uses a default config which might break deployments
(e.g. if number of threads is limited through cgroups)
Change-Id: Iaef3b91d2a555bf0681f4a7d018d6d93e93889b4
Signed-off-by: Manuel Buil <mbuil@suse.com>

The connection plugin no longer falls back on using the
inventory_hostname as the container_name. Set container_name as a host
var for each container in the test inventory.
Change-Id: I29025dea82ff8a0bcd03cbcf39ae7b34470f0a89

Change-Id: I8fd4c24fafcc0750fd5663e784ca4ca8fe8d9fa1

Change-Id: If4272e181c5f579c4e570ce3e4447220b3d2f9bf

Change-Id: I1dbb91f2aa69919609028c89b1cae8d454b11749

We want to default to running all tox environments under python 3, so
set the basepython value in each environment.
We do not want to specify a minor version number, because we do not
want to have to update the file every time we upgrade python.
We do not want to set the override once in testenv, because that
breaks the more specific versions used in default environments like
py35 and py36.
Change-Id: I22102abc36569501e256facb6ade9fdb28c3d47b
Signed-off-by: Doug Hellmann <doug@doughellmann.com>

Distributions normally provide one version of rabbitmq. Comparing this
version against the one provided by packagecloud makes little sense
unless the user explicitly requested to install the package from an
external source. As such, we should not complain when distribution
packages are used.
Change-Id: If56873908776ce7a6908f6c4d4aef096d084859f

The RDO repository provids a rabbitmq-server which is tested by the
RDO team so we should use that instead of the external one. We also
skip several tasks which add gpg keys and external repositories
since none of these steps is necessary when we install packages
from the distro repos.
Change-Id: I7c0a988f3aab14042ac2491b1021e789ba9ef4b3