openstack/openstack-ansible-rabbitmq_server - openstack-ansible-rabbitmq_server - OpenDev: Free Software Needs Free Tools

Preparing this role for the ansible-lint version bump
Change-Id: I45f923ffcb26efd85cdde73d096993e08132706a

Change-Id: I850105dd2460056399e55cb5e45222a450c13eb9

This commit does the following three things:
1. Updates test-install-rabbitmq-server.yml to use the correct
 rabbitmq host group
2. Copies test-upgrade.yml to test.yml, which should test both
 installation and upgrade of RabbitMQ
3. Updates test.yml to only perform upgrade testing when the package
 manager is != 'yum', this is due to [1]
4. Deletes test-upgrade.yml
[1] https://github.com/ansible/ansible-modules-core/pull/4547
Change-Id: I8f6c1b8d0de4666ab5f892162caa66f5c5c966d9

RabbitMQ nodes must all be stopped prior to a major/minor version
upgrade [1]. The role does this by distinguishing between the upgrader
node and the rest in separate stop and start tasks.
Upgrades can fail when more than one member of rabbitmq_all are not
members of the cluster. This is due to a bug fixed for greenfield
deployments by 5dc67955f0. The same fix
was not applied to upgrades because major/minor upgrades require all
RabbitMQ nodes to be stopped which is incompatible with serialising the
role in isolation.
This change uses a play to stop all but one of the nodes, prior to
running the rabbitmq_server role, and then serialises the running of
the role so that one node is upgraded at a time. This minimises the
downtime as much as possible while allowing the role to be applied to
one node at a time.
[1] http://www.rabbitmq.com/clustering.html#upgrading
Change-Id: Icca5cb1a96f83063223b6ddbeb02eeb562b0931b

With the implementation of https://review.openstack.org/388087 all
tox targets may now use upper constraints.
Change-Id: Idee4dc3e35fb0f67a3f12e641999753baee0182f

Added a water mark to the role documentation
to make clear to deployers which release they're
working with.
Modified conf.py that adds watermark to the documentation according
to particular branch. If the current branch is master than
watermark is 'Pre-release' and if the current branch is
stable/<release-name> than watermark is <release-name>.
This is a combined implementation based on the following
patches:
- https://review.openstack.org/372565
- https://review.openstack.org/382637
- https://review.openstack.org/384140
Change-Id: Iabd306e4598b100facdd34fa715439df72251d03

This change removes the use of 'ignore_errors: true' because it causes deployers
to see red output and a stacktrace, which traditionally means something is broken,
even when the failure is known to have a fall back option or be intentional. This
conversion will provide a generally cleaner interface.
It should be noted that the 'failed' filter will still function normally. Tasks
with the 'failed_when: false' option will still be marked as 'failed' in any
registered variable. This change simply makes the output look cleaner.
Change-Id: I34f49f829a61e25393fcec6b047aa28858c8eeb6
Closes-Bug: #1633438
Signed-off-by: Kevin Carter <kevin.carter@rackspace.com>

Releasenote translation publishing is being prepared. 'locale_dirs'
needs to be defined in conf.py to generate translated version of the
release notes.
Note that this repository might not get translated release notes - or
no translations at all - but we add the entry here nevertheless to
prepare for it.
Change-Id: I33f512560c3299527897998d1a8250549af259ff

This patch consumes the centralised Ansible test scripts
implemented in https://review.openstack.org/381853
Change-Id: Icbfcc4e2f6584803458c0eb7eb1239c459b83492

With https://review.openstack.org/381479 merged, setting this
variable in tox.ini via an extra var is unnecessary.
Change-Id: I1aa87d5ddfaefb1365c6eb42dca413ada2b71a35

For any openstack git sources, git.openstack.org must be used.
Change-Id: I98214b7da0644292508da84f459a65b3f1ea67fb

Change-Id: I70e651112a606681e760b9f6c7f917085e27828d

Change-Id: Iccb5da23204729d57671ab746202f8df3d54e106

This patch consumes the test scripts implemented by
https://review.openstack.org/375061 to ensure that
the tests and test preparation is consistent and
more maintainable.
Change-Id: Iea6a5793509df959e877a8974e3322a0b92ba360

Forcing dynamic includes for inventory-based conditionals
results in incomplete execution.
Change-Id: I50877c774c87f2e412ea77a2ed095f2dd61dc8ed

Ansible 2.1.1 introduces a regression in the way conditional
includes are handled which results in every task in the
included file being evaluated even if the condition for the
include is not met. This extends the run time significantly
for a deployment.
This patch forces all conditional includes to be dynamic.
Change-Id: I39d0110bae6e1c5b7f24d0ffcb75c35508d27aea
Related-Bug: https://github.com/ansible/ansible/issues/17687 

It is now included in test-setup-host
Change-Id: I2e205d5a839761efb70a395d6a38f37dcdaae6b7

Change-Id: I998ebc3a72f11d048942571003c85794b46bb6ac

This commit also moves the upgrade test to its own
scenario using tox environment func_upgrade
Closes-Bug: #1623592
Change-Id: Ib79d9c261c3bf5e018806867ebe804b5853908e9
Signed-off-by: Kevin Carter <kevin.carter@rackspace.com>

Queue mirroring is an example of a policy that may be
applied by the task, but other policies, such as expiry
are also possible
Change-Id: I7496bbc2e983f64bc8ddcc91b9e6499641f4ba82

Change-Id: Id013e531bad0d7938e726b26e2e005f028435507

Change-Id: I1039463e860e613f56fb2b813078d2c134f6b65d
Related-Bug: #1623164 

The volume of logs we collect in CI jobs are extensive. This
patch ensures that the logs collected are compressed to reduce
the space taken in CI systems.
PYTHONUNBUFFERED is also set to ensure that the console log
from the CI jobs is recorded in the exact order of execution.
Change-Id: I5eb6b16deaf3e0b01d46dae86ee40b1f8e90581d
Related-Bug: #1620849 

Previously the role assumed that all deployers wanted
all queues to be HA. Performance testing by Mirantis and
Intel has suggested that throughput increases can be dramatic
when disabling HA queues, see:
 http://docs.openstack.org/developer/performance-docs/test_results/mq/rabbitmq/index.html
Therefore, we should allow deployers to set their own
policies when desired.
Change-Id: I156b8618e78d74823ec568053157afc853baad84
Closes-Bug: #1607830 

The ``rabbitmq_server`` role now supports configuring HiPE compilation
of the RabbitMQ server Erlang code. This configuration option may improve
server performance for some workloads and hardware. Deployers can
override the ``rabbitmq_hipe_compile`` variable, setting a value of
``True`` if they wish to enable this feature.
Change-Id: I433d94eff00ac82a9069f9092faa87d449190442

Running `vagrant up ubuntu1404` brings up
a Trusty box and runs all of the gate checks
Change-Id: I47525461bc1e9a2145e754d1243ee1cb090e906c

The rabbitmq_plugins variable was mentioned as a loop item but was not
actually being used within the task to enable the management plugin.
It can now be overridden to enable or disable any RabbitMQ plugins.
Change-Id: I35f82427be464c811ee098ef676825aaa1e05d8d
Related-Bug: 1617431

This change enables log collection within the gate so that further analysis
on gate tasks can be performed post build. This is very useful when
debugging problems.
Change-Id: I64ba550208a690a784dbad8a3b871d0c1d703612
Signed-off-by: Kevin Carter <kevin.carter@rackspace.com>

1. Add collect_statistics_interval and rates_mode configurations in
rabbitmq.config template which enables to define custom value for
those fields.
2. Add collect_statistics_interval and rates_mode defaults in
defaults/main.yml
Change-Id: Ie349528929398f53a9d87e7fc02e0c95c9d6d4f1
Closes-bug: 1617516

Change the default install version of RabbitMQ Server to 3.6.5.
Change-Id: I35768c51e133dbf4f680a10d79b289beaaca71f9

As per [1] all linting tests can now use upper-constraints. This patch
removes all instances of the install_command override relating to lint
testing which were needed to negate the use of upper-constraints.
[1] http://lists.openstack.org/pipermail/openstack-dev/2016-August/101474.html
Change-Id: I4cbd9a5baa0d4ae96c600af104146c47813ebc90

Change-Id: I163b2d43152f2fcd2e5e2bdc7513342782639d9f

Some Linux distributions, such as CentOS 7 and Xenial, have trouble
validating SSL certificates when using get_url with servers
that use Server Name Indication (SNI).
This patch adds those packages to the list of required packages and
uses bindep to install them in developer test environments in the same
way that the gate tests install them.
Change-Id: Ia0ff77bb2423eeee14a5c7dcd7a2f12ef8c8f957

This adds python packages required for SNI support to ensure that tox
installs the packages into the venv when running tests.
Change-Id: I5277e8f7b172a2ab847e368d8780e9992b5b6a88

The plugin repo needs to be cloned for ansible-lint to
understand ansible plugins. The commands currently
reside in tox.ini under the ansible section and are not
currently included. This commit fixes that error.
Change-Id: Ic998e7f82a03a5008b6b15976c094b833a2a177e

The default filename for documenting binary dependencies has been
changed from "other-requirements.txt" to "bindep.txt" with the release
of bindep 2.1.0. While the previous name is still supported, it will
be deprecated.
Move the file around to follow this change.
Note that this change is self-testing, the OpenStack CI infrastructure
will use a "bindep.txt" file to setup nodes for testing.
For more information about bindep, see also:
http://docs.openstack.org/infra/manual/drivers.html#package-requirements
http://docs.openstack.org/infra/bindep/
As well as this announcement:
http://lists.openstack.org/pipermail/openstack-dev/2016-August/101590.html
Change-Id: I8456c503fe18c3eb7fca92f109308928cc15ad39

Update the role documentation to match the new format. Each role project
should maintain the configuration variations for the role project
itself.
Change-Id: I73b061da40b08b327fc3445e073cbd8997920ccd

While pip is not required for this role (it does not install any pip
packages) it does ensure that all the required packages are installed
in order to resolve SNI issues when Ansible executes the get_url task
to fetch the RabbitMQ package.
Change-Id: Ic55811136e01fbb9a400cfb8170fcda4fb3b3867
Signed-off-by: Kevin Carter <kevin.carter@rackspace.com>