openstack/swift - swift - OpenDev: Free Software Needs Free Tools

The relinker currently blindly calls get_hashes on partitions in the
new, upper half of the partition space, which can cause extra handoffs
to be created if you're rerunning the relink step for safety.
Even if the relinker were smarter, though, there's no reason that a
curious operator should end up creating empty handoffs just because
they're poking devices with REPLICATE requests
Drive-by: be a little more strict about the "suffixes" we're willing to
put in hashes.invalid and read out of hashes.pkl.
Change-Id: I9aace80088cd00d02c418fe4d782b662fb5c8bcf

There are times when it is convenient to specify a policy by name or
by index (see Related-Change), but policy names can unfortunately
collide with indexes. Using a number as a policy name should at least
be discouraged.
Change-Id: I0cdd3b86b527d6656b7fb50c699e3c0cc566e732
Related-Change: Icf1517bd930c74e9552b88250a7b4019e0ab413e

Change-Id: I8fd5d11e4b33a87b5fcb1a2d59c84986ca770fd8

It does the same thing as Python's staticmethod, so just use that instead.
Change-Id: Ib1974a6d315383583c36c440a503b39679c01443

Change-Id: Icf1517bd930c74e9552b88250a7b4019e0ab413e

Only the subclasses should be instantiated.
Co-Authored-By: Tim Burke <tim.burke@gmail.com>
Change-Id: I9b90863bb502ca8b95e626e83775475c352a7a4d
Related-Change: I21292e7991e93834b35cda6f5daea4c552a8e999

The partition progress logging line currently includes device, step and
the progress of partitions. But if your running a part-power increase on
more then one policy at a time, then we're missing a crucial piece of
information, the policy.
This patch add the policy to the log line too:
 Step: cleanup Device: sda1 Policy: <policy name> Partitions: 1/2
Change-Id: I1dd3362b0a35592867ddaaa86dfa9d95e241373a

ShardRange.OuterBound had the singleton-like property of all instances
of the same class being equal, but did not prevent multiple instances
being created. Instead, ShardRange.MIN and ShardRange.MAX are used to
hold single instances of each outer bound.
The ShardRange.OuterBound equality property was achieved by overriding
the default __eq__ method, but as a consequence the type was not
hashable, preventing it being used in lists or as a dict key without
also overriding the default __hash__ method.
This patch makes ShardRangeOuterBound a proper singleton, removing the
need to override __eq__ or __hash__.
Change-Id: I21292e7991e93834b35cda6f5daea4c552a8e999

Change-Id: I6805f0466f0200a58abe79cbb8ed3e6d2fd82d62

Add --partition option to restrict relinking to specified partitions.
The option can be repeated to specify multiple partitions.
Change-Id: I969cf20c1835fd150f56e55d4c15d3fec694029f

Add file to the reno documentation build to show release notes for
stable/wallaby.
Use pbr instruction to increment the minor version number
automatically so that master versions are higher than the versions on
stable/wallaby.
Sem-Ver: feature
Change-Id: Iaf730c040bcbff8c288e16d89fad3be073ba2550

Co-Authored-By: Clay Gerrard <clay.gerrard@gmail.com>
Change-Id: I1ec6d8c62ca47c2a039672331551a62c7fdab5cc

Add tests with cleanup scenarios for multiple files in source and
destination directories.
Change-Id: Ic07ea3f21a4febf789710e1c031f2b312bbced23

Shouldn't be any functional changes, though.
Change-Id: If906513ed47f203ca97ef08d4375b01c76f812bb

Change-Id: I31d11af3fdba844c5cd632925b8fd774b109dbd1

It's a little duplicative with test_relink_existing_data_meta_ts_files
but seems different enough to be worth testing.
Change-Id: I729fdafbeef5bcb48526f5b7e131647fb5f49727

Use the same logic for determining which files need to be linked in
both the relink and cleanup steps.
Collect and log stats for files linked and files removed.
Modify some of the logging messages.
Change-Id: I3d84a369d5e1d69193ca24fd3cccf28f734cc7cf

Add --policy option to restrict relinker to processing one policy.
Change-Id: I9455738f4677d9c3d72e8e18f5bde37f6a7f623e

Change-Id: I04dc249365bbdb511b036c7f433778ff30285591

Change-Id: I9a1ebec645ced755aece8e28452f51488c2b776c
Related-Change: I09143ae20bd6249083c0b80cdaa9d561e6abb301

Change-Id: I4510a126d8e5501d2ff977c8b1d9027b446feb96
Partial-Bug: 1920080

Refactor the relinker to reduce the amount of code that is
duplicated in the relink and cleanup functions.
Change-Id: Icf30f6799e4e5c7bb5c3d468c0e7e8591334ac1e

Some selenium webdrivers (e.g. Chrome, Firefox) support a headless
option so we can expose that as an option for the test runner too.
Use this in an attempt to fix "Error: cannot open display: :99" errors
seen in the gate.
Related-Bug: #1918864
Change-Id: I2a549ce829eb0bc38406575582202e1d8dd1a0e2

Refactor to make more use of the utils.get_partition_for_hash() helper
function that was added in [1].
[1] Related-Change: I5fbf8671f2ee63467d46f651e2c24529a2697626
Change-Id: I0d3c4cae88ed50a09e892e6d77b5aaa96e6195a5

Change-Id: I799bdacb7ef5850096c2178bfb12959f4205920d