Add support for data segments to SLO and SegmentedIterable

Code Issues Proposed changes

This patch updates the SLO middleware and SegmentedIterable to add
support for user-specified inlined-data segments. Such segments will
contain base64-encoded data to be added before/after an object-backed
segment within an SLO. To accommodate the potential extra data we
increase the default SLO maximum manifest size from 2MiB to 8MiB.
The default maximum number of segments remains 1000, but this will
only be enforced for object-backed segments.
This patch is a prerequisite for a future patch enabling the
download of large objects as tarballs. The TLO patch will be added
as a dependent patch later.
UpgradeImpact
=============
During a rolling upgrade, an updated proxy may write a manifest that
out-of-date proxies will not be able to read. This will resolve itself
once the upgrade completes on all nodes.
Change-Id: Ib8dc216a84d370e6da7d6b819af79582b671d699

This commit is contained in:

Joel Wright

2016年09月04日 23:51:53 +01:00

committed by Tim Burke

parent 0983a18344

commit 11bf9e4588

6 changed files with 706 additions and 148 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

2
etc/proxy-server.conf-sample

View File

@@ -738,7 +738,7 @@ use = egg:swift#bulk

[filter:slo]

use = egg:swift#slo

# max_manifest_segments = 1000

# max_manifest_size = 2097152

# max_manifest_size = 8388608

#

# Rate limiting applies only to segments smaller than this size (bytes).

# rate_limit_under_size = 1048576

Add support for data segments to SLO and SegmentedIterable

2 etc/proxy-server.conf-sample Unescape Escape View File

2
etc/proxy-server.conf-sample

View File